2023-10-30 06:52:39,342 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-10-30 06:52:39,578 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b 2023-10-30 06:52:39,590 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-30 06:52:39,591 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/cluster_c61b2f97-6a79-fbf9-8770-5add71ee2b48, deleteOnExit=true 2023-10-30 06:52:39,591 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-30 06:52:39,592 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/test.cache.data in system properties and HBase conf 2023-10-30 06:52:39,592 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/hadoop.tmp.dir in system properties and HBase conf 2023-10-30 06:52:39,593 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/hadoop.log.dir in system properties and HBase conf 2023-10-30 06:52:39,593 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-30 06:52:39,593 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-30 06:52:39,594 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-30 06:52:39,701 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-30 06:52:40,068 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-30 06:52:40,072 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-30 06:52:40,073 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-30 06:52:40,073 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-30 06:52:40,073 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-30 06:52:40,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-30 06:52:40,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-30 06:52:40,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-30 06:52:40,075 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-30 06:52:40,075 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-30 06:52:40,076 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/nfs.dump.dir in system properties and HBase conf 2023-10-30 06:52:40,076 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/java.io.tmpdir in system properties and HBase conf 2023-10-30 06:52:40,077 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-30 06:52:40,077 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-30 06:52:40,077 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-30 06:52:40,648 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-30 06:52:40,652 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-30 06:52:41,521 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-30 06:52:41,701 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-30 06:52:41,722 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-30 06:52:41,762 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-30 06:52:41,790 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/java.io.tmpdir/Jetty_localhost_45129_hdfs____y3t2v5/webapp 2023-10-30 06:52:41,916 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45129 2023-10-30 06:52:41,924 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-30 06:52:41,925 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-30 06:52:42,416 WARN [Listener at localhost/36111] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-30 06:52:42,491 WARN [Listener at localhost/36111] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-30 06:52:42,511 WARN [Listener at localhost/36111] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-30 06:52:42,518 INFO [Listener at localhost/36111] log.Slf4jLog(67): jetty-6.1.26 2023-10-30 06:52:42,525 INFO [Listener at localhost/36111] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/java.io.tmpdir/Jetty_localhost_37771_datanode____.s8a5v0/webapp 2023-10-30 06:52:42,607 INFO [Listener at localhost/36111] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37771 2023-10-30 06:52:42,939 WARN [Listener at localhost/40811] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-30 06:52:43,420 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3bf48a622f0ee8ab: Processing first storage report for DS-93e6a94b-8c93-4c7e-b5c8-4b95d0ff28dc from datanode 30dca24f-77be-4440-9d6d-61edddf4be81 2023-10-30 06:52:43,421 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3bf48a622f0ee8ab: from storage DS-93e6a94b-8c93-4c7e-b5c8-4b95d0ff28dc node DatanodeRegistration(127.0.0.1:39673, datanodeUuid=30dca24f-77be-4440-9d6d-61edddf4be81, infoPort=36309, infoSecurePort=0, ipcPort=40811, storageInfo=lv=-57;cid=testClusterID;nsid=925978492;c=1698648760718), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-30 06:52:43,421 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3bf48a622f0ee8ab: Processing first storage report for DS-aea989ea-e2e0-45b1-8def-b33c461da6e7 from datanode 30dca24f-77be-4440-9d6d-61edddf4be81 2023-10-30 06:52:43,421 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3bf48a622f0ee8ab: from storage DS-aea989ea-e2e0-45b1-8def-b33c461da6e7 node DatanodeRegistration(127.0.0.1:39673, datanodeUuid=30dca24f-77be-4440-9d6d-61edddf4be81, infoPort=36309, infoSecurePort=0, ipcPort=40811, storageInfo=lv=-57;cid=testClusterID;nsid=925978492;c=1698648760718), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-30 06:52:43,510 DEBUG [Listener at localhost/40811] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b 2023-10-30 06:52:43,577 INFO [Listener at localhost/40811] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/cluster_c61b2f97-6a79-fbf9-8770-5add71ee2b48/zookeeper_0, clientPort=50449, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/cluster_c61b2f97-6a79-fbf9-8770-5add71ee2b48/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/cluster_c61b2f97-6a79-fbf9-8770-5add71ee2b48/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-30 06:52:43,596 INFO [Listener at localhost/40811] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50449 2023-10-30 06:52:43,603 INFO [Listener at localhost/40811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 06:52:43,605 INFO [Listener at localhost/40811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 06:52:44,280 INFO [Listener at localhost/40811] util.FSUtils(471): Created version file at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10 with version=8 2023-10-30 06:52:44,280 INFO [Listener at localhost/40811] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/hbase-staging 2023-10-30 06:52:44,534 INFO [Listener at localhost/40811] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-30 06:52:44,925 INFO [Listener at localhost/40811] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=3 2023-10-30 06:52:44,951 INFO [Listener at localhost/40811] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-30 06:52:44,952 INFO [Listener at localhost/40811] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-30 06:52:44,952 INFO [Listener at localhost/40811] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-30 06:52:44,952 INFO [Listener at localhost/40811] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-30 06:52:44,952 INFO [Listener at localhost/40811] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-30 06:52:45,078 INFO [Listener at localhost/40811] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-30 06:52:45,137 DEBUG [Listener at localhost/40811] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-30 06:52:45,214 INFO [Listener at localhost/40811] ipc.NettyRpcServer(120): Bind to /148.251.75.209:37859 2023-10-30 06:52:45,222 INFO [Listener at localhost/40811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 06:52:45,224 INFO [Listener at localhost/40811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 06:52:45,243 INFO [Listener at localhost/40811] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37859 connecting to ZooKeeper ensemble=127.0.0.1:50449 2023-10-30 06:52:45,276 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:378590x0, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-30 06:52:45,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37859-0x101819dfdcb0000 connected 2023-10-30 06:52:45,327 DEBUG [Listener at localhost/40811] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-30 06:52:45,328 DEBUG [Listener at localhost/40811] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-30 06:52:45,331 DEBUG [Listener at localhost/40811] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-30 06:52:45,361 DEBUG [Listener at localhost/40811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37859 2023-10-30 06:52:45,364 DEBUG [Listener at localhost/40811] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37859 2023-10-30 06:52:45,372 DEBUG [Listener at localhost/40811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37859 2023-10-30 06:52:45,377 DEBUG [Listener at localhost/40811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37859 2023-10-30 06:52:45,386 DEBUG [Listener at localhost/40811] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37859 2023-10-30 06:52:45,393 INFO [Listener at localhost/40811] master.HMaster(444): hbase.rootdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10, hbase.cluster.distributed=false 2023-10-30 06:52:45,458 INFO [Listener at localhost/40811] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=3 2023-10-30 06:52:45,458 INFO [Listener at localhost/40811] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-30 06:52:45,458 INFO [Listener at localhost/40811] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-30 06:52:45,458 INFO [Listener at localhost/40811] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-30 06:52:45,459 INFO [Listener at localhost/40811] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-30 06:52:45,459 INFO [Listener at localhost/40811] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-30 06:52:45,463 INFO [Listener at localhost/40811] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-30 06:52:45,465 INFO [Listener at localhost/40811] ipc.NettyRpcServer(120): Bind to /148.251.75.209:40611 2023-10-30 06:52:45,468 INFO [Listener at localhost/40811] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-30 06:52:45,473 DEBUG [Listener at localhost/40811] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-10-30 06:52:45,474 INFO [Listener at localhost/40811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 06:52:45,477 INFO [Listener at localhost/40811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 06:52:45,480 INFO [Listener at localhost/40811] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40611 connecting to ZooKeeper ensemble=127.0.0.1:50449 2023-10-30 06:52:45,483 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:406110x0, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-30 06:52:45,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40611-0x101819dfdcb0001 connected 2023-10-30 06:52:45,484 DEBUG [Listener at localhost/40811] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-30 06:52:45,485 DEBUG [Listener at localhost/40811] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-30 06:52:45,486 DEBUG [Listener at localhost/40811] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-30 06:52:45,490 DEBUG [Listener at localhost/40811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40611 2023-10-30 06:52:45,490 DEBUG [Listener at localhost/40811] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40611 2023-10-30 06:52:45,491 DEBUG [Listener at localhost/40811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40611 2023-10-30 06:52:45,491 DEBUG [Listener at localhost/40811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40611 2023-10-30 06:52:45,494 DEBUG [Listener at localhost/40811] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40611 2023-10-30 06:52:45,496 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,37859,1698648764408 2023-10-30 06:52:45,503 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-30 06:52:45,505 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,37859,1698648764408 2023-10-30 06:52:45,521 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-30 06:52:45,521 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-30 06:52:45,521 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 06:52:45,522 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-30 06:52:45,523 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,37859,1698648764408 from backup master directory 2023-10-30 06:52:45,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-30 06:52:45,526 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,37859,1698648764408 2023-10-30 06:52:45,526 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-30 06:52:45,526 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-30 06:52:45,527 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,37859,1698648764408 2023-10-30 06:52:45,529 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-30 06:52:45,530 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-30 06:52:45,613 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/hbase.id with ID: 40b10acf-f672-4228-8cc9-4a6311cabba7 2023-10-30 06:52:45,662 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 06:52:45,677 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 06:52:45,715 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5be5b0d9 to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:52:45,744 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69b57016, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:52:45,766 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-30 06:52:45,769 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-30 06:52:45,786 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-30 06:52:45,786 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-30 06:52:45,788 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-30 06:52:45,792 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-30 06:52:45,793 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-30 06:52:45,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/MasterData/data/master/store-tmp 2023-10-30 06:52:45,852 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:52:45,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-30 06:52:45,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 06:52:45,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 06:52:45,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-30 06:52:45,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 06:52:45,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 06:52:45,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-30 06:52:45,855 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/MasterData/WALs/jenkins-hbase20.apache.org,37859,1698648764408 2023-10-30 06:52:45,879 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37859%2C1698648764408, suffix=, logDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/MasterData/WALs/jenkins-hbase20.apache.org,37859,1698648764408, archiveDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/MasterData/oldWALs, maxLogs=10 2023-10-30 06:52:45,933 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39673,DS-93e6a94b-8c93-4c7e-b5c8-4b95d0ff28dc,DISK] 2023-10-30 06:52:45,940 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-30 06:52:46,002 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/MasterData/WALs/jenkins-hbase20.apache.org,37859,1698648764408/jenkins-hbase20.apache.org%2C37859%2C1698648764408.1698648765889 2023-10-30 06:52:46,002 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39673,DS-93e6a94b-8c93-4c7e-b5c8-4b95d0ff28dc,DISK]] 2023-10-30 06:52:46,003 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:52:46,003 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:52:46,006 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-30 06:52:46,007 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-30 06:52:46,073 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-30 06:52:46,081 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-30 06:52:46,110 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-30 06:52:46,124 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:52:46,131 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-30 06:52:46,133 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-30 06:52:46,154 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-30 06:52:46,159 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:52:46,161 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70227434, jitterRate=0.046470314264297485}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:52:46,161 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-30 06:52:46,162 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-30 06:52:46,179 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-30 06:52:46,179 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-30 06:52:46,181 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-30 06:52:46,183 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-30 06:52:46,212 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 28 msec 2023-10-30 06:52:46,212 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-30 06:52:46,245 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-30 06:52:46,252 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-30 06:52:46,283 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-30 06:52:46,288 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-30 06:52:46,294 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-30 06:52:46,299 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-30 06:52:46,303 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-30 06:52:46,307 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 06:52:46,309 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-30 06:52:46,310 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-30 06:52:46,324 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-30 06:52:46,585 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-30 06:52:46,586 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-30 06:52:46,586 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 06:52:46,592 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,37859,1698648764408, sessionid=0x101819dfdcb0000, setting cluster-up flag (Was=false) 2023-10-30 06:52:46,606 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 06:52:46,609 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-30 06:52:46,611 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,37859,1698648764408 2023-10-30 06:52:46,614 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 06:52:46,618 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-30 06:52:46,619 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,37859,1698648764408 2023-10-30 06:52:46,621 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot/.tmp 2023-10-30 06:52:46,698 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(951): ClusterId : 40b10acf-f672-4228-8cc9-4a6311cabba7 2023-10-30 06:52:46,702 DEBUG [RS:0;jenkins-hbase20:40611] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-30 06:52:46,708 DEBUG [RS:0;jenkins-hbase20:40611] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-30 06:52:46,708 DEBUG [RS:0;jenkins-hbase20:40611] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-30 06:52:46,711 DEBUG [RS:0;jenkins-hbase20:40611] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-30 06:52:46,713 DEBUG [RS:0;jenkins-hbase20:40611] zookeeper.ReadOnlyZKClient(139): Connect 0x7904e8bd to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:52:46,728 DEBUG [RS:0;jenkins-hbase20:40611] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77c319ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:52:46,729 DEBUG [RS:0;jenkins-hbase20:40611] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73fc83cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-30 06:52:46,734 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-30 06:52:46,746 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-30 06:52:46,746 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-30 06:52:46,746 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-30 06:52:46,746 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-30 06:52:46,746 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-10-30 06:52:46,746 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 06:52:46,747 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-30 06:52:46,747 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 06:52:46,749 DEBUG [RS:0;jenkins-hbase20:40611] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:40611 2023-10-30 06:52:46,751 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1698648796751 2023-10-30 06:52:46,753 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-30 06:52:46,754 INFO [RS:0;jenkins-hbase20:40611] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-30 06:52:46,755 INFO [RS:0;jenkins-hbase20:40611] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-30 06:52:46,755 DEBUG [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1022): About to register with Master. 2023-10-30 06:52:46,755 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-30 06:52:46,756 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-30 06:52:46,760 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,37859,1698648764408 with isa=jenkins-hbase20.apache.org/148.251.75.209:40611, startcode=1698648765457 2023-10-30 06:52:46,761 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-30 06:52:46,765 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-30 06:52:46,772 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-30 06:52:46,772 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-30 06:52:46,773 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-30 06:52:46,773 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-30 06:52:46,774 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-30 06:52:46,777 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-30 06:52:46,779 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-30 06:52:46,779 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-30 06:52:46,780 DEBUG [RS:0;jenkins-hbase20:40611] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-30 06:52:46,782 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-30 06:52:46,783 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-30 06:52:46,785 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698648766784,5,FailOnTimeoutGroup] 2023-10-30 06:52:46,786 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698648766786,5,FailOnTimeoutGroup] 2023-10-30 06:52:46,787 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-30 06:52:46,787 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-30 06:52:46,789 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-30 06:52:46,789 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-30 06:52:46,837 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52579, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-30 06:52:46,848 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37859] master.ServerManager(388): Registering regionserver=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:46,862 DEBUG [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10 2023-10-30 06:52:46,862 DEBUG [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36111 2023-10-30 06:52:46,862 DEBUG [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-30 06:52:46,867 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-30 06:52:46,867 DEBUG [RS:0;jenkins-hbase20:40611] zookeeper.ZKUtil(162): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:46,867 WARN [RS:0;jenkins-hbase20:40611] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-30 06:52:46,868 INFO [RS:0;jenkins-hbase20:40611] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-30 06:52:46,869 DEBUG [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/WALs/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:46,870 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,40611,1698648765457] 2023-10-30 06:52:46,880 DEBUG [RS:0;jenkins-hbase20:40611] zookeeper.ZKUtil(162): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:46,890 DEBUG [RS:0;jenkins-hbase20:40611] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-30 06:52:46,898 INFO [RS:0;jenkins-hbase20:40611] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-30 06:52:46,920 INFO [RS:0;jenkins-hbase20:40611] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-30 06:52:46,924 INFO [RS:0;jenkins-hbase20:40611] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:52:46,924 INFO [RS:0;jenkins-hbase20:40611] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:52:46,925 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-30 06:52:46,931 INFO [RS:0;jenkins-hbase20:40611] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-10-30 06:52:46,932 DEBUG [RS:0;jenkins-hbase20:40611] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 06:52:46,932 DEBUG [RS:0;jenkins-hbase20:40611] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 06:52:46,933 DEBUG [RS:0;jenkins-hbase20:40611] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 06:52:46,933 DEBUG [RS:0;jenkins-hbase20:40611] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 06:52:46,933 DEBUG [RS:0;jenkins-hbase20:40611] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 06:52:46,933 DEBUG [RS:0;jenkins-hbase20:40611] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-30 06:52:46,933 DEBUG [RS:0;jenkins-hbase20:40611] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 06:52:46,933 DEBUG [RS:0;jenkins-hbase20:40611] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 06:52:46,934 DEBUG [RS:0;jenkins-hbase20:40611] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 06:52:46,934 DEBUG [RS:0;jenkins-hbase20:40611] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-30 06:52:46,935 INFO [RS:0;jenkins-hbase20:40611] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-30 06:52:46,935 INFO [RS:0;jenkins-hbase20:40611] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-30 06:52:46,935 INFO [RS:0;jenkins-hbase20:40611] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-30 06:52:46,949 INFO [RS:0;jenkins-hbase20:40611] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-30 06:52:46,951 INFO [RS:0;jenkins-hbase20:40611] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40611,1698648765457-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:52:46,965 INFO [RS:0;jenkins-hbase20:40611] regionserver.Replication(203): jenkins-hbase20.apache.org,40611,1698648765457 started 2023-10-30 06:52:46,965 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,40611,1698648765457, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:40611, sessionid=0x101819dfdcb0001 2023-10-30 06:52:46,966 DEBUG [RS:0;jenkins-hbase20:40611] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-30 06:52:46,966 DEBUG [RS:0;jenkins-hbase20:40611] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:46,966 DEBUG [RS:0;jenkins-hbase20:40611] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,40611,1698648765457' 2023-10-30 06:52:46,966 DEBUG [RS:0;jenkins-hbase20:40611] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:46,967 DEBUG [RS:0;jenkins-hbase20:40611] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:46,967 DEBUG [RS:0;jenkins-hbase20:40611] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-30 06:52:46,967 DEBUG [RS:0;jenkins-hbase20:40611] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-30 06:52:46,967 DEBUG [RS:0;jenkins-hbase20:40611] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:46,968 DEBUG [RS:0;jenkins-hbase20:40611] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,40611,1698648765457' 2023-10-30 06:52:46,968 DEBUG [RS:0;jenkins-hbase20:40611] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-30 06:52:46,968 DEBUG [RS:0;jenkins-hbase20:40611] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-30 06:52:46,968 DEBUG [RS:0;jenkins-hbase20:40611] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-30 06:52:46,969 INFO [RS:0;jenkins-hbase20:40611] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-30 06:52:46,969 INFO [RS:0;jenkins-hbase20:40611] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-30 06:52:47,080 INFO [RS:0;jenkins-hbase20:40611] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C40611%2C1698648765457, suffix=, logDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/WALs/jenkins-hbase20.apache.org,40611,1698648765457, archiveDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/oldWALs, maxLogs=32 2023-10-30 06:52:47,099 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39673,DS-93e6a94b-8c93-4c7e-b5c8-4b95d0ff28dc,DISK] 2023-10-30 06:52:47,103 INFO [RS:0;jenkins-hbase20:40611] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/WALs/jenkins-hbase20.apache.org,40611,1698648765457/jenkins-hbase20.apache.org%2C40611%2C1698648765457.1698648767083 2023-10-30 06:52:47,104 DEBUG [RS:0;jenkins-hbase20:40611] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39673,DS-93e6a94b-8c93-4c7e-b5c8-4b95d0ff28dc,DISK]] 2023-10-30 06:52:47,198 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-30 06:52:47,199 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-30 06:52:47,200 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10 2023-10-30 06:52:47,614 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:52:47,617 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-30 06:52:47,625 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/info 2023-10-30 06:52:47,627 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-30 06:52:47,629 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:52:47,629 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-30 06:52:47,633 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/rep_barrier 2023-10-30 06:52:47,634 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-30 06:52:47,636 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:52:47,636 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-30 06:52:47,647 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/table 2023-10-30 06:52:47,648 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-30 06:52:47,649 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:52:47,652 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740 2023-10-30 06:52:47,653 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740 2023-10-30 06:52:47,658 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-30 06:52:47,661 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-30 06:52:47,668 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:52:47,669 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74182692, jitterRate=0.10540825128555298}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-30 06:52:47,669 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-30 06:52:47,669 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-30 06:52:47,670 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-30 06:52:47,670 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-30 06:52:47,670 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-30 06:52:47,670 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-30 06:52:47,670 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-30 06:52:47,671 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-30 06:52:47,676 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-30 06:52:47,676 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-30 06:52:47,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-30 06:52:47,697 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-30 06:52:47,699 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-30 06:52:47,851 DEBUG [jenkins-hbase20:37859] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-10-30 06:52:47,854 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,40611,1698648765457, state=OPENING 2023-10-30 06:52:47,861 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-30 06:52:47,862 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 06:52:47,863 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-30 06:52:47,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:52:48,053 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:48,056 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-30 06:52:48,059 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-30 06:52:48,072 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-30 06:52:48,072 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-30 06:52:48,077 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C40611%2C1698648765457.meta, suffix=.meta, logDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/WALs/jenkins-hbase20.apache.org,40611,1698648765457, archiveDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/oldWALs, maxLogs=32 2023-10-30 06:52:48,095 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39673,DS-93e6a94b-8c93-4c7e-b5c8-4b95d0ff28dc,DISK] 2023-10-30 06:52:48,104 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/WALs/jenkins-hbase20.apache.org,40611,1698648765457/jenkins-hbase20.apache.org%2C40611%2C1698648765457.meta.1698648768078.meta 2023-10-30 06:52:48,104 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39673,DS-93e6a94b-8c93-4c7e-b5c8-4b95d0ff28dc,DISK]] 2023-10-30 06:52:48,104 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:52:48,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-30 06:52:48,126 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-30 06:52:48,131 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-30 06:52:48,136 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-30 06:52:48,136 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:52:48,136 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-30 06:52:48,136 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-30 06:52:48,139 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-30 06:52:48,141 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/info 2023-10-30 06:52:48,141 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/info 2023-10-30 06:52:48,142 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-30 06:52:48,143 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:52:48,143 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-30 06:52:48,144 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/rep_barrier 2023-10-30 06:52:48,144 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/rep_barrier 2023-10-30 06:52:48,145 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-30 06:52:48,146 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:52:48,146 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-30 06:52:48,148 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/table 2023-10-30 06:52:48,148 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/table 2023-10-30 06:52:48,148 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-30 06:52:48,149 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:52:48,151 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740 2023-10-30 06:52:48,153 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740 2023-10-30 06:52:48,157 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-30 06:52:48,159 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-30 06:52:48,160 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59283263, jitterRate=-0.11661054193973541}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-30 06:52:48,161 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-30 06:52:48,170 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1698648768045 2023-10-30 06:52:48,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-30 06:52:48,184 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-30 06:52:48,185 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,40611,1698648765457, state=OPEN 2023-10-30 06:52:48,187 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-30 06:52:48,187 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-30 06:52:48,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-30 06:52:48,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,40611,1698648765457 in 322 msec 2023-10-30 06:52:48,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-30 06:52:48,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 509 msec 2023-10-30 06:52:48,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5390 sec 2023-10-30 06:52:48,203 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1698648768203, completionTime=-1 2023-10-30 06:52:48,204 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-10-30 06:52:48,204 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-10-30 06:52:48,262 DEBUG [hconnection-0x2a1b55ca-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:52:48,266 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:52:48,283 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-10-30 06:52:48,283 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1698648828283 2023-10-30 06:52:48,284 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1698648888284 2023-10-30 06:52:48,284 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 80 msec 2023-10-30 06:52:48,313 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37859,1698648764408-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:52:48,313 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37859,1698648764408-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-30 06:52:48,314 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37859,1698648764408-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-30 06:52:48,316 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:37859, period=300000, unit=MILLISECONDS is enabled. 2023-10-30 06:52:48,316 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-30 06:52:48,322 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-30 06:52:48,334 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-30 06:52:48,336 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-30 06:52:48,348 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-30 06:52:48,351 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 06:52:48,354 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 06:52:48,375 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/hbase/namespace/5971c46cef08b3c058774f8431adbf7f 2023-10-30 06:52:48,377 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/hbase/namespace/5971c46cef08b3c058774f8431adbf7f empty. 2023-10-30 06:52:48,378 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/hbase/namespace/5971c46cef08b3c058774f8431adbf7f 2023-10-30 06:52:48,378 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-30 06:52:48,813 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-30 06:52:48,817 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5971c46cef08b3c058774f8431adbf7f, NAME => 'hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:52:49,234 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:52:49,234 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 5971c46cef08b3c058774f8431adbf7f, disabling compactions & flushes 2023-10-30 06:52:49,235 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f. 2023-10-30 06:52:49,235 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f. 2023-10-30 06:52:49,235 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f. after waiting 0 ms 2023-10-30 06:52:49,235 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f. 2023-10-30 06:52:49,235 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f. 2023-10-30 06:52:49,235 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 5971c46cef08b3c058774f8431adbf7f: 2023-10-30 06:52:49,240 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 06:52:49,258 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698648769243"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648769243"}]},"ts":"1698648769243"} 2023-10-30 06:52:49,290 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 06:52:49,292 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 06:52:49,297 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648769293"}]},"ts":"1698648769293"} 2023-10-30 06:52:49,301 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-30 06:52:49,307 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5971c46cef08b3c058774f8431adbf7f, ASSIGN}] 2023-10-30 06:52:49,310 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5971c46cef08b3c058774f8431adbf7f, ASSIGN 2023-10-30 06:52:49,311 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5971c46cef08b3c058774f8431adbf7f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:52:49,463 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5971c46cef08b3c058774f8431adbf7f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:49,463 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698648769463"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648769463"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648769463"}]},"ts":"1698648769463"} 2023-10-30 06:52:49,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5971c46cef08b3c058774f8431adbf7f, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:52:49,623 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:49,629 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f. 2023-10-30 06:52:49,630 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5971c46cef08b3c058774f8431adbf7f, NAME => 'hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:52:49,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5971c46cef08b3c058774f8431adbf7f 2023-10-30 06:52:49,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:52:49,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5971c46cef08b3c058774f8431adbf7f 2023-10-30 06:52:49,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5971c46cef08b3c058774f8431adbf7f 2023-10-30 06:52:49,633 INFO [StoreOpener-5971c46cef08b3c058774f8431adbf7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5971c46cef08b3c058774f8431adbf7f 2023-10-30 06:52:49,636 DEBUG [StoreOpener-5971c46cef08b3c058774f8431adbf7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/namespace/5971c46cef08b3c058774f8431adbf7f/info 2023-10-30 06:52:49,636 DEBUG [StoreOpener-5971c46cef08b3c058774f8431adbf7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/namespace/5971c46cef08b3c058774f8431adbf7f/info 2023-10-30 06:52:49,637 INFO [StoreOpener-5971c46cef08b3c058774f8431adbf7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5971c46cef08b3c058774f8431adbf7f columnFamilyName info 2023-10-30 06:52:49,638 INFO [StoreOpener-5971c46cef08b3c058774f8431adbf7f-1] regionserver.HStore(310): Store=5971c46cef08b3c058774f8431adbf7f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:52:49,639 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/namespace/5971c46cef08b3c058774f8431adbf7f 2023-10-30 06:52:49,640 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/namespace/5971c46cef08b3c058774f8431adbf7f 2023-10-30 06:52:49,644 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5971c46cef08b3c058774f8431adbf7f 2023-10-30 06:52:49,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/namespace/5971c46cef08b3c058774f8431adbf7f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:52:49,648 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5971c46cef08b3c058774f8431adbf7f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72828104, jitterRate=0.08522331714630127}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:52:49,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5971c46cef08b3c058774f8431adbf7f: 2023-10-30 06:52:49,650 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f., pid=6, masterSystemTime=1698648769623 2023-10-30 06:52:49,654 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f. 2023-10-30 06:52:49,654 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f. 2023-10-30 06:52:49,655 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5971c46cef08b3c058774f8431adbf7f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:49,655 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698648769654"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648769654"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648769654"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648769654"}]},"ts":"1698648769654"} 2023-10-30 06:52:49,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-30 06:52:49,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5971c46cef08b3c058774f8431adbf7f, server=jenkins-hbase20.apache.org,40611,1698648765457 in 190 msec 2023-10-30 06:52:49,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-30 06:52:49,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5971c46cef08b3c058774f8431adbf7f, ASSIGN in 355 msec 2023-10-30 06:52:49,666 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 06:52:49,667 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648769667"}]},"ts":"1698648769667"} 2023-10-30 06:52:49,670 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-30 06:52:49,673 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 06:52:49,676 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3360 sec 2023-10-30 06:52:49,752 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-30 06:52:49,754 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-30 06:52:49,754 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 06:52:49,794 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-30 06:52:49,809 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-30 06:52:49,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-10-30 06:52:49,828 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-30 06:52:49,839 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-30 06:52:49,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-10-30 06:52:49,859 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-30 06:52:49,860 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-30 06:52:49,861 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.334sec 2023-10-30 06:52:49,863 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-30 06:52:49,865 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-30 06:52:49,866 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-30 06:52:49,867 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37859,1698648764408-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-30 06:52:49,867 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37859,1698648764408-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-30 06:52:49,880 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-30 06:52:49,908 DEBUG [Listener at localhost/40811] zookeeper.ReadOnlyZKClient(139): Connect 0x5d4d4a7f to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:52:49,914 DEBUG [Listener at localhost/40811] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5525bc17, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:52:49,927 DEBUG [hconnection-0x748c77c0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:52:49,938 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:52:49,947 INFO [Listener at localhost/40811] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,37859,1698648764408 2023-10-30 06:52:49,949 DEBUG [Listener at localhost/40811] zookeeper.ReadOnlyZKClient(139): Connect 0x7f296166 to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:52:49,954 DEBUG [Listener at localhost/40811] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@922abed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:52:49,954 INFO [Listener at localhost/40811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 06:52:49,979 INFO [Listener at localhost/40811] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=210, OpenFileDescriptor=478, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=171, AvailableMemoryMB=3237 2023-10-30 06:52:49,989 DEBUG [Listener at localhost/40811] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:52:49,993 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:52:50,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 06:52:50,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:50,008 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 06:52:50,011 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 06:52:50,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-10-30 06:52:50,013 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:52:50,016 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e empty. 2023-10-30 06:52:50,018 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:52:50,018 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-10-30 06:52:50,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 06:52:50,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 06:52:50,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 06:52:50,440 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-10-30 06:52:50,443 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 305c2d1857b49805ca7b04e765dbff9e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:52:50,463 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:52:50,463 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 305c2d1857b49805ca7b04e765dbff9e, disabling compactions & flushes 2023-10-30 06:52:50,463 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:50,463 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:50,463 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. after waiting 0 ms 2023-10-30 06:52:50,463 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:50,464 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:50,464 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:52:50,469 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 06:52:50,471 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698648770471"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648770471"}]},"ts":"1698648770471"} 2023-10-30 06:52:50,478 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 06:52:50,480 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 06:52:50,481 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648770480"}]},"ts":"1698648770480"} 2023-10-30 06:52:50,483 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-10-30 06:52:50,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=305c2d1857b49805ca7b04e765dbff9e, ASSIGN}] 2023-10-30 06:52:50,491 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=305c2d1857b49805ca7b04e765dbff9e, ASSIGN 2023-10-30 06:52:50,493 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=305c2d1857b49805ca7b04e765dbff9e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:52:50,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 06:52:50,645 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=305c2d1857b49805ca7b04e765dbff9e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:50,645 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698648770644"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648770644"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648770644"}]},"ts":"1698648770644"} 2023-10-30 06:52:50,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 305c2d1857b49805ca7b04e765dbff9e, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:52:50,807 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:50,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:50,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 305c2d1857b49805ca7b04e765dbff9e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:52:50,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:52:50,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:52:50,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:52:50,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:52:50,823 INFO [StoreOpener-305c2d1857b49805ca7b04e765dbff9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:52:50,826 DEBUG [StoreOpener-305c2d1857b49805ca7b04e765dbff9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1 2023-10-30 06:52:50,826 DEBUG [StoreOpener-305c2d1857b49805ca7b04e765dbff9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1 2023-10-30 06:52:50,830 INFO [StoreOpener-305c2d1857b49805ca7b04e765dbff9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 305c2d1857b49805ca7b04e765dbff9e columnFamilyName family1 2023-10-30 06:52:50,834 INFO [StoreOpener-305c2d1857b49805ca7b04e765dbff9e-1] regionserver.HStore(310): Store=305c2d1857b49805ca7b04e765dbff9e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:52:50,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:52:50,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:52:50,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:52:50,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:52:50,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 305c2d1857b49805ca7b04e765dbff9e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58932251, jitterRate=-0.12184102833271027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:52:50,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:52:50,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e., pid=11, masterSystemTime=1698648770807 2023-10-30 06:52:50,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:50,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:50,851 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=305c2d1857b49805ca7b04e765dbff9e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:50,851 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698648770851"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648770851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648770851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648770851"}]},"ts":"1698648770851"} 2023-10-30 06:52:50,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-30 06:52:50,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 305c2d1857b49805ca7b04e765dbff9e, server=jenkins-hbase20.apache.org,40611,1698648765457 in 203 msec 2023-10-30 06:52:50,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-30 06:52:50,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=305c2d1857b49805ca7b04e765dbff9e, ASSIGN in 370 msec 2023-10-30 06:52:50,862 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 06:52:50,862 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648770862"}]},"ts":"1698648770862"} 2023-10-30 06:52:50,864 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-10-30 06:52:50,867 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 06:52:50,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 862 msec 2023-10-30 06:52:51,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 06:52:51,140 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-10-30 06:52:51,161 DEBUG [hconnection-0x763306cf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:52:51,164 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:52:51,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:52:51,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:51,304 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:51,304 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:51,305 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 06:52:51,305 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 06:52:51,305 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:51,305 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:51,306 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:51,306 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:51,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:51,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:51,307 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:51,307 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:52:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:51,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:52:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:51,308 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:51,310 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:51,310 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 06:52:51,310 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:51,311 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 06:52:51,311 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:52:51,311 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:52:51,311 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:51,312 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. started... 2023-10-30 06:52:51,313 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 305c2d1857b49805ca7b04e765dbff9e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 06:52:51,845 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130141aca7f6df14c92be90820f50f5108c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130141aca7f6df14c92be90820f50f5108c 2023-10-30 06:52:52,261 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/4b984e8775784a40b0c2fd5f48e24760 2023-10-30 06:52:52,280 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/4b984e8775784a40b0c2fd5f48e24760 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/4b984e8775784a40b0c2fd5f48e24760 2023-10-30 06:52:52,290 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/4b984e8775784a40b0c2fd5f48e24760, entries=1000, sequenceid=5, filesize=175.8 K 2023-10-30 06:52:52,294 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 305c2d1857b49805ca7b04e765dbff9e in 980ms, sequenceid=5, compaction requested=false 2023-10-30 06:52:52,295 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:52,298 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:52:52,298 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:52,299 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:52:52,299 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:52:52,299 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,299 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 06:52:52,299 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 06:52:52,301 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,301 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:52,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:52,301 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,301 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:52:52,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:52,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:52,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:52,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 06:52:52,304 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 06:52:52,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c6001e2[Count = 0] remaining members to acquire global barrier 2023-10-30 06:52:52,304 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,305 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,305 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 06:52:52,305 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 06:52:52,305 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:52:52,305 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,305 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:52:52,307 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,307 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 06:52:52,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:52,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:52,307 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:52,307 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 06:52:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:52,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:52:52,311 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 06:52:52,311 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:52:52,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 06:52:52,311 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:52:52,311 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,311 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:52:52,318 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,318 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,318 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:52,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:52,319 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:52,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:52,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,321 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:52,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,327 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,327 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:52,328 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:52,328 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:52,328 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:52,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:52,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:52:52,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:52,328 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,328 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,328 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,328 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,328 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:52,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:52,330 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 06:52:52,330 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:52:52,431 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:52:52,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:52:52,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:52:52,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 06:52:52,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,456 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:52,456 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:52,457 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 06:52:52,457 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 06:52:52,458 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,458 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,459 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:52,459 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:52,460 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:52,460 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:52:52,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,460 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:52:52,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,461 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,462 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 06:52:52,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:52,462 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 06:52:52,462 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:52,463 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 06:52:52,463 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:52:52,463 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:52:52,463 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:52,463 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. started... 2023-10-30 06:52:52,463 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 305c2d1857b49805ca7b04e765dbff9e 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 06:52:52,893 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285420f6aa4fd94317aa3599e3f182d104 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285420f6aa4fd94317aa3599e3f182d104 2023-10-30 06:52:52,894 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-30 06:52:52,895 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-30 06:52:53,308 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/3a9edc806a474f48ae52b00967ea9258 2023-10-30 06:52:53,320 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/3a9edc806a474f48ae52b00967ea9258 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/3a9edc806a474f48ae52b00967ea9258 2023-10-30 06:52:53,329 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/3a9edc806a474f48ae52b00967ea9258, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 06:52:53,330 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 305c2d1857b49805ca7b04e765dbff9e in 867ms, sequenceid=9, compaction requested=false 2023-10-30 06:52:53,331 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:52:53,331 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:53,331 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:52:53,331 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:52:53,331 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,331 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 06:52:53,331 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 06:52:53,333 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,333 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:53,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:53,333 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,334 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:52:53,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:53,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:53,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:53,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 06:52:53,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54f55fc7[Count = 0] remaining members to acquire global barrier 2023-10-30 06:52:53,336 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 06:52:53,336 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,337 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,337 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 06:52:53,337 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 06:52:53,337 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:52:53,337 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,337 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:52:53,340 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 06:52:53,340 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,340 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:53,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:53,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:53,341 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 06:52:53,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:53,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:53,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:52:53,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 06:52:53,345 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 06:52:53,345 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:52:53,345 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:52:53,345 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,345 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:52:53,351 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,351 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,352 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:53,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:53,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:53,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:53,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:53,352 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,354 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:53,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,360 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,360 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:53,360 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:53,360 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:53,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:53,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:52:53,360 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,361 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,360 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:53,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 06:52:53,361 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:53,362 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:53,362 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,362 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 06:52:53,362 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:52:53,462 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:52:53,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:52:53,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:52:53,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 06:52:53,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,477 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:53,477 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:53,477 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 06:52:53,477 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 06:52:53,478 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,478 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,479 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,479 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:53,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:53,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:53,479 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:53,479 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:52:53,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:52:53,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,481 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,481 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 06:52:53,481 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:53,481 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 06:52:53,481 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:53,481 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 06:52:53,481 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:52:53,481 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:52:53,481 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:53,482 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. started... 2023-10-30 06:52:53,482 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 305c2d1857b49805ca7b04e765dbff9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:52:53,664 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 06:52:53,908 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120195ab1e2d66cc4f94822bee86b7cc4351 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120195ab1e2d66cc4f94822bee86b7cc4351 2023-10-30 06:52:54,321 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/5c296931e7d343c5a107ac7d18a7031c 2023-10-30 06:52:54,331 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/5c296931e7d343c5a107ac7d18a7031c as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/5c296931e7d343c5a107ac7d18a7031c 2023-10-30 06:52:54,341 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/5c296931e7d343c5a107ac7d18a7031c, entries=1, sequenceid=13, filesize=5.0 K 2023-10-30 06:52:54,342 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 305c2d1857b49805ca7b04e765dbff9e in 860ms, sequenceid=13, compaction requested=true 2023-10-30 06:52:54,342 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:52:54,343 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:54,343 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:52:54,343 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:52:54,343 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,343 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 06:52:54,343 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 06:52:54,345 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,345 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:54,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:54,346 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,346 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:52:54,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:54,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:54,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:54,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 06:52:54,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76e80dcc[Count = 0] remaining members to acquire global barrier 2023-10-30 06:52:54,347 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 06:52:54,347 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,348 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,348 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 06:52:54,348 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 06:52:54,348 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:52:54,349 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,349 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:52:54,350 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,350 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 06:52:54,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,350 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:54,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:54,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:54,350 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 06:52:54,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:54,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:54,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:54,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:52:54,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 06:52:54,353 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 06:52:54,354 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:52:54,354 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:52:54,354 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,354 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:52:54,355 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,355 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,355 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:54,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:54,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:54,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:54,357 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:54,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:54,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:54,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,358 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:54,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,366 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,366 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:54,366 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:54,366 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:54,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 06:52:54,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:54,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:54,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:52:54,366 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,366 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:54,366 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,367 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,367 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,367 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:54,367 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 06:52:54,368 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:52:54,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:54,468 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:52:54,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:52:54,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:52:54,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 06:52:54,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,486 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:54,486 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:54,486 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 06:52:54,486 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 06:52:54,487 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,487 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,487 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,487 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:54,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:54,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:54,488 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,488 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:52:54,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:52:54,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,489 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,489 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 06:52:54,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,489 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 06:52:54,489 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:54,490 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 06:52:54,492 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:52:54,492 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:54,492 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:52:54,492 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. started... 2023-10-30 06:52:54,493 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 305c2d1857b49805ca7b04e765dbff9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:52:54,531 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-30 06:52:54,531 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-30 06:52:54,922 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b3423cf1d5ea40ebad1a37c065b3df32 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205b3423cf1d5ea40ebad1a37c065b3df32 2023-10-30 06:52:54,938 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/f9e7f6c09c0e490abd952577d4a4537a 2023-10-30 06:52:54,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/f9e7f6c09c0e490abd952577d4a4537a as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/f9e7f6c09c0e490abd952577d4a4537a 2023-10-30 06:52:54,964 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/f9e7f6c09c0e490abd952577d4a4537a, entries=1, sequenceid=17, filesize=5.0 K 2023-10-30 06:52:54,965 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 305c2d1857b49805ca7b04e765dbff9e in 472ms, sequenceid=17, compaction requested=true 2023-10-30 06:52:54,965 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:52:54,966 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:54,966 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:52:54,968 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:52:54,968 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,968 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 06:52:54,968 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 06:52:54,970 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,970 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:54,971 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,971 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:52:54,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:54,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:54,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:54,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 06:52:54,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b79af21[Count = 0] remaining members to acquire global barrier 2023-10-30 06:52:54,973 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 06:52:54,973 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,983 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,983 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 06:52:54,983 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 06:52:54,983 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,983 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:52:54,983 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:52:54,985 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 06:52:54,985 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,985 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:54,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,986 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 06:52:54,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:54,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:54,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:52:54,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 06:52:54,990 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 06:52:54,990 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:52:54,990 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:52:54,990 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,990 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:52:54,999 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,999 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,999 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:54,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:54,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:55,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:55,000 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:55,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:55,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:55,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:55,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,001 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,008 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:55,008 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:55,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:55,008 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:55,008 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:55,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:52:55,008 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,008 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:55,008 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,009 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 06:52:55,009 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:55,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:55,009 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:52:55,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 06:52:55,009 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,010 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,110 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:52:55,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:52:55,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:52:55,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 06:52:55,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,125 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:55,125 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:55,125 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 06:52:55,125 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 06:52:55,126 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,126 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,127 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:55,127 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:55,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:55,128 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,128 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:52:55,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:52:55,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,129 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,129 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 06:52:55,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,129 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 06:52:55,129 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:55,130 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 06:52:55,130 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:52:55,130 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:52:55,130 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:55,130 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. started... 2023-10-30 06:52:55,130 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 305c2d1857b49805ca7b04e765dbff9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:52:55,163 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f5ee9aff76bd4e228c67d3ac9525ffa6 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228f5ee9aff76bd4e228c67d3ac9525ffa6 2023-10-30 06:52:55,579 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/a2c75775da0d4cc7b6a328b9ea91cf78 2023-10-30 06:52:55,590 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/a2c75775da0d4cc7b6a328b9ea91cf78 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/a2c75775da0d4cc7b6a328b9ea91cf78 2023-10-30 06:52:55,604 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/a2c75775da0d4cc7b6a328b9ea91cf78, entries=1, sequenceid=21, filesize=5.0 K 2023-10-30 06:52:55,606 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 305c2d1857b49805ca7b04e765dbff9e in 476ms, sequenceid=21, compaction requested=true 2023-10-30 06:52:55,606 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:52:55,606 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:55,606 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:52:55,607 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:52:55,607 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,607 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 06:52:55,607 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 06:52:55,609 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,609 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:55,610 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,610 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:52:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:55,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 06:52:55,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37eac8bd[Count = 0] remaining members to acquire global barrier 2023-10-30 06:52:55,612 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 06:52:55,612 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,613 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,613 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 06:52:55,613 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 06:52:55,614 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:52:55,614 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,614 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:52:55,615 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,615 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 06:52:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,615 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:55,615 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 06:52:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:55,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:52:55,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 06:52:55,619 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 06:52:55,619 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:52:55,619 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:52:55,619 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,619 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:52:55,620 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,620 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,620 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:55,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:55,621 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:55,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,623 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:55,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,625 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,625 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,625 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,625 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:55,625 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:55,626 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:55,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 06:52:55,625 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:55,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:55,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:55,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:52:55,626 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,627 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,627 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:55,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:55,627 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 06:52:55,627 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:52:55,727 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:52:55,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:52:55,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:52:55,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 06:52:55,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,739 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:55,739 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:55,743 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 06:52:55,743 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 06:52:55,743 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,743 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,744 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:55,744 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:55,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:55,745 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:55,745 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:52:55,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:52:55,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,746 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,746 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 06:52:55,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:55,746 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 06:52:55,746 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:55,747 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 06:52:55,747 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:52:55,747 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:52:55,747 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:55,747 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. started... 2023-10-30 06:52:55,747 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 305c2d1857b49805ca7b04e765dbff9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:52:56,197 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512315a4847377cff4a4ebe1521f055d0a44e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512315a4847377cff4a4ebe1521f055d0a44e 2023-10-30 06:52:56,218 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/3d97bb5d03f141ea8985bf8a4cf560a7 2023-10-30 06:52:56,232 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/3d97bb5d03f141ea8985bf8a4cf560a7 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/3d97bb5d03f141ea8985bf8a4cf560a7 2023-10-30 06:52:56,244 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/3d97bb5d03f141ea8985bf8a4cf560a7, entries=1, sequenceid=25, filesize=5.0 K 2023-10-30 06:52:56,245 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 305c2d1857b49805ca7b04e765dbff9e in 498ms, sequenceid=25, compaction requested=true 2023-10-30 06:52:56,245 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:52:56,245 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:56,246 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:52:56,246 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:52:56,246 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,246 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 06:52:56,246 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 06:52:56,248 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,248 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:56,248 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,248 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:52:56,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:56,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 06:52:56,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@499fa2e0[Count = 0] remaining members to acquire global barrier 2023-10-30 06:52:56,250 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 06:52:56,251 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,251 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,252 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 06:52:56,252 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 06:52:56,252 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,252 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:52:56,252 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:52:56,253 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 06:52:56,253 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,253 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:56,253 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 06:52:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:56,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:56,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:56,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:56,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:52:56,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 06:52:56,258 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 06:52:56,259 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:52:56,259 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:52:56,259 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,259 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:52:56,268 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,268 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:56,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:56,268 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:56,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:56,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:56,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:56,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,270 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:56,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,271 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,277 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:56,277 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:56,277 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,277 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:56,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:52:56,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:56,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:56,277 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,278 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,278 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,278 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,278 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,278 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 06:52:56,278 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:52:56,277 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:56,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:56,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:56,378 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:52:56,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:52:56,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:52:56,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 06:52:56,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,404 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:56,404 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:56,405 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 06:52:56,405 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 06:52:56,406 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,406 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,407 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,407 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:56,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:56,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,408 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:56,408 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:52:56,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:52:56,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,409 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,410 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 06:52:56,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:56,410 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 06:52:56,410 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:56,411 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 06:52:56,414 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:52:56,415 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:56,415 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:52:56,415 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. started... 2023-10-30 06:52:56,415 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 305c2d1857b49805ca7b04e765dbff9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:52:56,855 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a36ed79e6983493ab711c6feb92c3a5a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101a36ed79e6983493ab711c6feb92c3a5a 2023-10-30 06:52:57,308 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/444241a0788040ccb0814b0d813a4026 2023-10-30 06:52:57,324 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/444241a0788040ccb0814b0d813a4026 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/444241a0788040ccb0814b0d813a4026 2023-10-30 06:52:57,335 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/444241a0788040ccb0814b0d813a4026, entries=1, sequenceid=29, filesize=5.0 K 2023-10-30 06:52:57,336 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 305c2d1857b49805ca7b04e765dbff9e in 921ms, sequenceid=29, compaction requested=true 2023-10-30 06:52:57,336 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:52:57,337 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:57,337 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:52:57,337 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:52:57,337 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,337 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 06:52:57,337 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 06:52:57,339 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,339 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:57,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:57,339 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,339 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:52:57,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:57,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:57,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:57,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 06:52:57,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f2f4072[Count = 0] remaining members to acquire global barrier 2023-10-30 06:52:57,342 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 06:52:57,342 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,343 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,343 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 06:52:57,343 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 06:52:57,343 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:52:57,343 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,343 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:52:57,344 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 06:52:57,344 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,344 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:57,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:57,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:57,344 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 06:52:57,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:57,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:57,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:57,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:52:57,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 06:52:57,348 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 06:52:57,348 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:52:57,348 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:52:57,348 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,348 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:52:57,357 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,357 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:57,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,357 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:57,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:57,358 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,360 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,367 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,367 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:57,367 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:57,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:57,368 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:57,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:57,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:52:57,368 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,368 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:57,368 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:57,369 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:57,369 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 06:52:57,369 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:52:57,369 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,370 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,470 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:52:57,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:52:57,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:52:57,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 06:52:57,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,487 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:57,487 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:57,487 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 06:52:57,487 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 06:52:57,488 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,488 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,489 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,489 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:57,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:57,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:57,489 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,489 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:52:57,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:52:57,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,491 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,491 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 06:52:57,491 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,491 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 06:52:57,491 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:57,492 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 06:52:57,492 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:52:57,493 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:52:57,493 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:57,493 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. started... 2023-10-30 06:52:57,493 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 305c2d1857b49805ca7b04e765dbff9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:52:57,584 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ffcb08fb98ba485d88d9c6109170068b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103ffcb08fb98ba485d88d9c6109170068b 2023-10-30 06:52:57,604 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/68184b05e9f347b9ac40c0e446368dc5 2023-10-30 06:52:57,614 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/68184b05e9f347b9ac40c0e446368dc5 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/68184b05e9f347b9ac40c0e446368dc5 2023-10-30 06:52:57,623 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/68184b05e9f347b9ac40c0e446368dc5, entries=1, sequenceid=33, filesize=5.0 K 2023-10-30 06:52:57,625 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 305c2d1857b49805ca7b04e765dbff9e in 132ms, sequenceid=33, compaction requested=true 2023-10-30 06:52:57,625 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:52:57,625 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:57,625 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:52:57,626 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:52:57,626 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,626 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 06:52:57,626 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 06:52:57,627 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,627 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:57,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:57,628 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,628 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:52:57,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:57,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:57,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:57,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 06:52:57,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7929e811[Count = 0] remaining members to acquire global barrier 2023-10-30 06:52:57,630 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 06:52:57,630 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,631 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,631 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 06:52:57,631 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 06:52:57,631 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:52:57,632 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,632 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:52:57,632 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 06:52:57,632 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:57,633 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 06:52:57,633 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:57,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:57,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:57,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:57,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:52:57,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 06:52:57,653 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 06:52:57,653 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:52:57,653 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:52:57,653 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,653 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:52:57,655 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,655 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,655 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:57,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:57,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:57,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:57,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:57,656 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:57,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:57,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,658 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:57,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,660 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:57,660 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:57,660 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:57,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:57,661 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:57,661 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,661 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:57,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:52:57,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 06:52:57,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:57,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:57,662 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 06:52:57,662 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:52:57,665 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,665 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,665 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,665 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,763 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:52:57,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:52:57,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:52:57,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 06:52:57,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,777 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:57,777 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:57,778 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 06:52:57,778 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 06:52:57,779 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,779 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,780 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:57,780 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:57,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:57,780 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,780 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:52:57,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:52:57,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,781 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,782 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 06:52:57,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,782 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 06:52:57,782 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:57,782 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 06:52:57,786 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:52:57,786 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:57,786 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:52:57,787 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. started... 2023-10-30 06:52:57,787 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 305c2d1857b49805ca7b04e765dbff9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:52:57,820 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e0726d10433b457592d8e1086a1e306e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907e0726d10433b457592d8e1086a1e306e 2023-10-30 06:52:57,842 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/24c53b2e212a430e85a51c01e0e8df63 2023-10-30 06:52:57,854 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/24c53b2e212a430e85a51c01e0e8df63 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/24c53b2e212a430e85a51c01e0e8df63 2023-10-30 06:52:57,864 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/24c53b2e212a430e85a51c01e0e8df63, entries=1, sequenceid=37, filesize=5.0 K 2023-10-30 06:52:57,866 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 305c2d1857b49805ca7b04e765dbff9e in 79ms, sequenceid=37, compaction requested=true 2023-10-30 06:52:57,866 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:52:57,866 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:57,866 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:52:57,867 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:52:57,867 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,867 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 06:52:57,867 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 06:52:57,868 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,868 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:57,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:57,869 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:57,869 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:52:57,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:57,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:57,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 06:52:57,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18e768a9[Count = 0] remaining members to acquire global barrier 2023-10-30 06:52:57,870 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 06:52:57,870 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,871 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,872 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 06:52:57,872 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 06:52:57,872 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:52:57,872 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,872 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:52:57,873 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,873 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 06:52:57,873 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,873 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 06:52:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:52:57,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 06:52:57,877 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 06:52:57,877 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:52:57,877 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:52:57,877 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,878 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:52:57,885 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,885 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:57,885 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:57,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:57,886 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:57,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,887 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:57,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,893 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,893 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:57,893 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,893 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,893 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:57,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:57,893 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:57,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:57,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:57,893 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:57,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:52:57,895 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,895 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,895 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:57,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:57,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:57,896 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 06:52:57,896 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:52:57,996 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:52:57,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:52:58,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:52:58,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 06:52:58,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,013 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:58,013 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:58,014 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 06:52:58,014 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 06:52:58,015 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,015 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,016 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:58,016 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:58,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:58,016 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,016 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:52:58,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:52:58,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,020 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,020 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 06:52:58,020 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,020 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 06:52:58,021 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:52:58,021 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 06:52:58,026 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:52:58,026 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:58,026 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:52:58,026 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. started... 2023-10-30 06:52:58,027 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 305c2d1857b49805ca7b04e765dbff9e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:52:58,076 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120873fb53a504e4051b6185ebfef8d4f50 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120873fb53a504e4051b6185ebfef8d4f50 2023-10-30 06:52:58,500 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/1b7a00f0d57d4126a81adab8ee77307f 2023-10-30 06:52:58,518 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/1b7a00f0d57d4126a81adab8ee77307f as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/1b7a00f0d57d4126a81adab8ee77307f 2023-10-30 06:52:58,534 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/1b7a00f0d57d4126a81adab8ee77307f, entries=1, sequenceid=41, filesize=5.0 K 2023-10-30 06:52:58,536 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 305c2d1857b49805ca7b04e765dbff9e in 510ms, sequenceid=41, compaction requested=true 2023-10-30 06:52:58,536 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:52:58,536 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:58,536 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:52:58,537 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:52:58,537 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,537 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 06:52:58,537 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 06:52:58,539 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,539 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:58,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:58,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:58,540 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,540 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:52:58,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:58,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:58,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 06:52:58,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cdb41f7[Count = 0] remaining members to acquire global barrier 2023-10-30 06:52:58,542 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 06:52:58,542 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,544 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,545 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 06:52:58,545 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 06:52:58,545 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:52:58,545 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,545 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:52:58,546 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 06:52:58,546 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:58,546 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 06:52:58,547 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:58,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:58,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:58,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:58,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:58,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:52:58,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 06:52:58,551 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 06:52:58,551 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:52:58,551 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:52:58,551 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,551 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:52:58,560 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,561 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:52:58,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:52:58,561 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:58,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:58,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:58,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:52:58,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,563 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:52:58,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,565 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:52:58,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,568 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,568 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,568 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,568 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:52:58,568 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,568 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,569 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,569 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:52:58,569 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:52:58,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:52:58,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:52:58,569 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:52:58,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 06:52:58,569 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 06:52:58,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:52:58,570 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 06:52:58,571 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:52:58,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:52:58,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:52:58,671 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:52:58,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:52:58,680 DEBUG [Listener at localhost/40811] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-30 06:52:58,688 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-30 06:52:58,690 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:52:58,721 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 06:52:58,722 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 06:52:58,725 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649378725 2023-10-30 06:52:58,726 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:52:58,731 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 06:52:58,741 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-10-30 06:52:58,742 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 06:52:58,744 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x5308628e to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:52:58,762 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b107a10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:52:58,766 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:52:58,969 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103def638a2b76148b3ae0db6897b72b4af to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103def638a2b76148b3ae0db6897b72b4af 2023-10-30 06:52:58,970 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 06:52:58,997 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:52:58,999 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:52:59,040 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:52:59,043 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:52:59,124 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bcb67b2d79534f0588ce52bd0fd311f4 first=Optional[r3] last=Optional[r6] 2023-10-30 06:52:59,146 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bcb67b2d79534f0588ce52bd0fd311f4}] 2023-10-30 06:52:59,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bcb67b2d79534f0588ce52bd0fd311f4 for inclusion in 305c2d1857b49805ca7b04e765dbff9e/family1 2023-10-30 06:52:59,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 06:52:59,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:52:59,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:52:59,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bcb67b2d79534f0588ce52bd0fd311f4 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c8glfi98u19pvp3uhfgfq3lip33ncmoph6aqigl2j2en5kmbve4g2ap3ridfct0t/family1/bcb67b2d79534f0588ce52bd0fd311f4 2023-10-30 06:52:59,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c8glfi98u19pvp3uhfgfq3lip33ncmoph6aqigl2j2en5kmbve4g2ap3ridfct0t/family1/bcb67b2d79534f0588ce52bd0fd311f4 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/9a0832eb60e44f6b900dee5aafaa9b45_SeqId_44_ 2023-10-30 06:52:59,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c8glfi98u19pvp3uhfgfq3lip33ncmoph6aqigl2j2en5kmbve4g2ap3ridfct0t/family1/bcb67b2d79534f0588ce52bd0fd311f4 into 305c2d1857b49805ca7b04e765dbff9e/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/9a0832eb60e44f6b900dee5aafaa9b45_SeqId_44_ - updating store file list. 2023-10-30 06:52:59,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/9a0832eb60e44f6b900dee5aafaa9b45_SeqId_44_ into 305c2d1857b49805ca7b04e765dbff9e/family1 2023-10-30 06:52:59,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c8glfi98u19pvp3uhfgfq3lip33ncmoph6aqigl2j2en5kmbve4g2ap3ridfct0t/family1/bcb67b2d79534f0588ce52bd0fd311f4 into 305c2d1857b49805ca7b04e765dbff9e/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/9a0832eb60e44f6b900dee5aafaa9b45_SeqId_44_) 2023-10-30 06:52:59,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c8glfi98u19pvp3uhfgfq3lip33ncmoph6aqigl2j2en5kmbve4g2ap3ridfct0t/family1/bcb67b2d79534f0588ce52bd0fd311f4 2023-10-30 06:52:59,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 06:52:59,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 06:52:59,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(1912): 305c2d1857b49805ca7b04e765dbff9e/family1 is initiating minor compaction 2023-10-30 06:52:59,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@19997ee0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:52:59,237 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 305c2d1857b49805ca7b04e765dbff9e/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:52:59,238 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/3a9edc806a474f48ae52b00967ea9258, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/5c296931e7d343c5a107ac7d18a7031c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/f9e7f6c09c0e490abd952577d4a4537a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/a2c75775da0d4cc7b6a328b9ea91cf78, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/3d97bb5d03f141ea8985bf8a4cf560a7, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/444241a0788040ccb0814b0d813a4026, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/68184b05e9f347b9ac40c0e446368dc5, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/24c53b2e212a430e85a51c01e0e8df63, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/1b7a00f0d57d4126a81adab8ee77307f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/9a0832eb60e44f6b900dee5aafaa9b45_SeqId_44_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp, totalSize=50.2 K 2023-10-30 06:52:59,241 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 3a9edc806a474f48ae52b00967ea9258, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 06:52:59,241 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 5c296931e7d343c5a107ac7d18a7031c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 06:52:59,242 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting f9e7f6c09c0e490abd952577d4a4537a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 06:52:59,242 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting a2c75775da0d4cc7b6a328b9ea91cf78, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 06:52:59,242 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 3d97bb5d03f141ea8985bf8a4cf560a7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 06:52:59,242 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 444241a0788040ccb0814b0d813a4026, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 06:52:59,242 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 68184b05e9f347b9ac40c0e446368dc5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 06:52:59,242 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 24c53b2e212a430e85a51c01e0e8df63, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 06:52:59,242 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 1b7a00f0d57d4126a81adab8ee77307f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 06:52:59,243 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 9a0832eb60e44f6b900dee5aafaa9b45_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 06:52:59,251 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 06:52:59,253 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:52:59,262 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228f5ee9aff76bd4e228c67d3ac9525ffa6 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228f5ee9aff76bd4e228c67d3ac9525ffa6 2023-10-30 06:52:59,265 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512315a4847377cff4a4ebe1521f055d0a44e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512315a4847377cff4a4ebe1521f055d0a44e 2023-10-30 06:52:59,273 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101a36ed79e6983493ab711c6feb92c3a5a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101a36ed79e6983493ab711c6feb92c3a5a 2023-10-30 06:52:59,276 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103ffcb08fb98ba485d88d9c6109170068b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103ffcb08fb98ba485d88d9c6109170068b 2023-10-30 06:52:59,276 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-10-30 06:52:59,276 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 06:52:59,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:52:59,278 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:52:59,278 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:52:59,278 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:52:59,278 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:52:59,278 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:52:59,278 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:52:59,278 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:52:59,563 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): 305c2d1857b49805ca7b04e765dbff9e#family1#compaction#10 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:52:59,645 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/0873c104818b41fcb056bdce5099b8a4 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/0873c104818b41fcb056bdce5099b8a4 2023-10-30 06:52:59,683 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 305c2d1857b49805ca7b04e765dbff9e/family1 of 305c2d1857b49805ca7b04e765dbff9e into 0873c104818b41fcb056bdce5099b8a4(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:52:59,683 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:52:59,686 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1698648779227; duration=0sec 2023-10-30 06:52:59,687 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:52:59,751 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/3a9edc806a474f48ae52b00967ea9258, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/5c296931e7d343c5a107ac7d18a7031c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/f9e7f6c09c0e490abd952577d4a4537a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/a2c75775da0d4cc7b6a328b9ea91cf78, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/3d97bb5d03f141ea8985bf8a4cf560a7, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/444241a0788040ccb0814b0d813a4026, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/68184b05e9f347b9ac40c0e446368dc5, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/24c53b2e212a430e85a51c01e0e8df63, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/1b7a00f0d57d4126a81adab8ee77307f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/9a0832eb60e44f6b900dee5aafaa9b45_SeqId_44_] to archive 2023-10-30 06:52:59,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:52:59,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/3a9edc806a474f48ae52b00967ea9258 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/3a9edc806a474f48ae52b00967ea9258 2023-10-30 06:52:59,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/5c296931e7d343c5a107ac7d18a7031c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/5c296931e7d343c5a107ac7d18a7031c 2023-10-30 06:52:59,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/f9e7f6c09c0e490abd952577d4a4537a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/f9e7f6c09c0e490abd952577d4a4537a 2023-10-30 06:52:59,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/a2c75775da0d4cc7b6a328b9ea91cf78 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/a2c75775da0d4cc7b6a328b9ea91cf78 2023-10-30 06:52:59,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/3d97bb5d03f141ea8985bf8a4cf560a7 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/3d97bb5d03f141ea8985bf8a4cf560a7 2023-10-30 06:52:59,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/444241a0788040ccb0814b0d813a4026 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/444241a0788040ccb0814b0d813a4026 2023-10-30 06:52:59,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/68184b05e9f347b9ac40c0e446368dc5 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/68184b05e9f347b9ac40c0e446368dc5 2023-10-30 06:52:59,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/24c53b2e212a430e85a51c01e0e8df63 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/24c53b2e212a430e85a51c01e0e8df63 2023-10-30 06:52:59,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/1b7a00f0d57d4126a81adab8ee77307f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/1b7a00f0d57d4126a81adab8ee77307f 2023-10-30 06:52:59,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/9a0832eb60e44f6b900dee5aafaa9b45_SeqId_44_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/9a0832eb60e44f6b900dee5aafaa9b45_SeqId_44_ 2023-10-30 06:52:59,987 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120531840474cfdd43e8acd018871bd58d52 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120531840474cfdd43e8acd018871bd58d52 2023-10-30 06:52:59,993 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 06:53:00,053 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f6dc888c844d4d938060fe887493cc2e first=Optional[r00] last=Optional[r2] 2023-10-30 06:53:00,054 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f6dc888c844d4d938060fe887493cc2e}] 2023-10-30 06:53:00,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f6dc888c844d4d938060fe887493cc2e for inclusion in 305c2d1857b49805ca7b04e765dbff9e/family1 2023-10-30 06:53:00,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-30 06:53:00,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:53:00,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:53:00,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f6dc888c844d4d938060fe887493cc2e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c3amqhbs8jv6blquj25lfn2a7nuj128d0slftb7iaktrjrj75oenntaoc7br2qar/family1/f6dc888c844d4d938060fe887493cc2e 2023-10-30 06:53:00,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c3amqhbs8jv6blquj25lfn2a7nuj128d0slftb7iaktrjrj75oenntaoc7br2qar/family1/f6dc888c844d4d938060fe887493cc2e as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/d1817d477a044da587c55c2c9c2fe6d2_SeqId_47_ 2023-10-30 06:53:00,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c3amqhbs8jv6blquj25lfn2a7nuj128d0slftb7iaktrjrj75oenntaoc7br2qar/family1/f6dc888c844d4d938060fe887493cc2e into 305c2d1857b49805ca7b04e765dbff9e/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/d1817d477a044da587c55c2c9c2fe6d2_SeqId_47_ - updating store file list. 2023-10-30 06:53:00,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/d1817d477a044da587c55c2c9c2fe6d2_SeqId_47_ into 305c2d1857b49805ca7b04e765dbff9e/family1 2023-10-30 06:53:00,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c3amqhbs8jv6blquj25lfn2a7nuj128d0slftb7iaktrjrj75oenntaoc7br2qar/family1/f6dc888c844d4d938060fe887493cc2e into 305c2d1857b49805ca7b04e765dbff9e/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/d1817d477a044da587c55c2c9c2fe6d2_SeqId_47_) 2023-10-30 06:53:00,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c3amqhbs8jv6blquj25lfn2a7nuj128d0slftb7iaktrjrj75oenntaoc7br2qar/family1/f6dc888c844d4d938060fe887493cc2e 2023-10-30 06:53:00,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 06:53:00,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 06:53:00,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(1912): 305c2d1857b49805ca7b04e765dbff9e/family1 is initiating minor compaction (all files) 2023-10-30 06:53:00,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@20deda47; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:00,084 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 305c2d1857b49805ca7b04e765dbff9e/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:53:00,085 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/4b984e8775784a40b0c2fd5f48e24760, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/0873c104818b41fcb056bdce5099b8a4, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/d1817d477a044da587c55c2c9c2fe6d2_SeqId_47_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp, totalSize=358.6 K 2023-10-30 06:53:00,086 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 4b984e8775784a40b0c2fd5f48e24760, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878849956 2023-10-30 06:53:00,086 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 0873c104818b41fcb056bdce5099b8a4, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621249956 2023-10-30 06:53:00,087 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting d1817d477a044da587c55c2c9c2fe6d2_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878849956 2023-10-30 06:53:00,088 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 06:53:00,089 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:00,093 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130141aca7f6df14c92be90820f50f5108c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130141aca7f6df14c92be90820f50f5108c 2023-10-30 06:53:00,101 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120195ab1e2d66cc4f94822bee86b7cc4351 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120195ab1e2d66cc4f94822bee86b7cc4351 2023-10-30 06:53:00,105 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205b3423cf1d5ea40ebad1a37c065b3df32 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205b3423cf1d5ea40ebad1a37c065b3df32 2023-10-30 06:53:00,106 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-10-30 06:53:00,106 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 06:53:00,107 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:53:00,107 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 06:53:00,108 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:00,109 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 06:53:00,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.4100 sec 2023-10-30 06:53:00,192 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): 305c2d1857b49805ca7b04e765dbff9e#family1#compaction#11 average throughput is 2.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:53:00,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 06:53:00,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:53:00,504 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-10-30 06:53:00,507 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-10-30 06:53:00,507 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-10-30 06:53:00,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-10-30 06:53:00,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=305c2d1857b49805ca7b04e765dbff9e, REOPEN/MOVE}] 2023-10-30 06:53:00,536 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=305c2d1857b49805ca7b04e765dbff9e, REOPEN/MOVE 2023-10-30 06:53:00,538 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=305c2d1857b49805ca7b04e765dbff9e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:00,538 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698648780538"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648780538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648780538"}]},"ts":"1698648780538"} 2023-10-30 06:53:00,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 305c2d1857b49805ca7b04e765dbff9e, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:53:00,701 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:00,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:53:00,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 305c2d1857b49805ca7b04e765dbff9e, disabling compactions & flushes 2023-10-30 06:53:00,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:53:01,102 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/.tmp/family1/b3fee0ffa45c4bdba6e2e3389a592bf4 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/b3fee0ffa45c4bdba6e2e3389a592bf4 2023-10-30 06:53:01,111 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 305c2d1857b49805ca7b04e765dbff9e/family1 of 305c2d1857b49805ca7b04e765dbff9e into b3fee0ffa45c4bdba6e2e3389a592bf4(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:53:01,111 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:53:01,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:53:01,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:53:01,113 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1698648780084; duration=1sec 2023-10-30 06:53:01,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. after waiting 0 ms 2023-10-30 06:53:01,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:53:01,113 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:01,117 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/4b984e8775784a40b0c2fd5f48e24760, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/0873c104818b41fcb056bdce5099b8a4, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/d1817d477a044da587c55c2c9c2fe6d2_SeqId_47_] to archive 2023-10-30 06:53:01,119 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:01,122 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/4b984e8775784a40b0c2fd5f48e24760 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/4b984e8775784a40b0c2fd5f48e24760 2023-10-30 06:53:01,124 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/0873c104818b41fcb056bdce5099b8a4 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/0873c104818b41fcb056bdce5099b8a4 2023-10-30 06:53:01,126 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/d1817d477a044da587c55c2c9c2fe6d2_SeqId_47_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/d1817d477a044da587c55c2c9c2fe6d2_SeqId_47_ 2023-10-30 06:53:01,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-30 06:53:01,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:53:01,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:53:01,136 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 305c2d1857b49805ca7b04e765dbff9e to self. 2023-10-30 06:53:01,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:53:01,139 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=305c2d1857b49805ca7b04e765dbff9e, regionState=CLOSED 2023-10-30 06:53:01,139 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698648781139"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648781139"}]},"ts":"1698648781139"} 2023-10-30 06:53:01,144 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-10-30 06:53:01,144 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 305c2d1857b49805ca7b04e765dbff9e, server=jenkins-hbase20.apache.org,40611,1698648765457 in 600 msec 2023-10-30 06:53:01,145 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=305c2d1857b49805ca7b04e765dbff9e, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=true 2023-10-30 06:53:01,295 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=305c2d1857b49805ca7b04e765dbff9e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:01,296 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698648781295"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648781295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648781295"}]},"ts":"1698648781295"} 2023-10-30 06:53:01,298 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 305c2d1857b49805ca7b04e765dbff9e, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:53:01,451 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:01,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:53:01,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 305c2d1857b49805ca7b04e765dbff9e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:53:01,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:53:01,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:01,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:53:01,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:53:01,458 INFO [StoreOpener-305c2d1857b49805ca7b04e765dbff9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:53:01,460 DEBUG [StoreOpener-305c2d1857b49805ca7b04e765dbff9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1 2023-10-30 06:53:01,460 DEBUG [StoreOpener-305c2d1857b49805ca7b04e765dbff9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1 2023-10-30 06:53:01,460 INFO [StoreOpener-305c2d1857b49805ca7b04e765dbff9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 305c2d1857b49805ca7b04e765dbff9e columnFamilyName family1 2023-10-30 06:53:01,468 DEBUG [StoreOpener-305c2d1857b49805ca7b04e765dbff9e-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/b3fee0ffa45c4bdba6e2e3389a592bf4 2023-10-30 06:53:01,468 INFO [StoreOpener-305c2d1857b49805ca7b04e765dbff9e-1] regionserver.HStore(310): Store=305c2d1857b49805ca7b04e765dbff9e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:53:01,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:53:01,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:53:01,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:53:01,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 305c2d1857b49805ca7b04e765dbff9e; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70296617, jitterRate=0.04750122129917145}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:53:01,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:53:01,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e., pid=17, masterSystemTime=1698648781451 2023-10-30 06:53:01,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:53:01,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:53:01,480 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=305c2d1857b49805ca7b04e765dbff9e, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:01,480 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698648781480"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648781480"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648781480"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648781480"}]},"ts":"1698648781480"} 2023-10-30 06:53:01,484 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-10-30 06:53:01,484 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 305c2d1857b49805ca7b04e765dbff9e, server=jenkins-hbase20.apache.org,40611,1698648765457 in 184 msec 2023-10-30 06:53:01,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-30 06:53:01,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=305c2d1857b49805ca7b04e765dbff9e, REOPEN/MOVE in 950 msec 2023-10-30 06:53:01,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-10-30 06:53:01,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 975 msec 2023-10-30 06:53:01,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0260 sec 2023-10-30 06:53:01,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-10-30 06:53:01,506 INFO [Listener at localhost/40811] compactions.TestMobCompactor(278): alter status finished 2023-10-30 06:53:01,507 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 06:53:01,509 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 06:53:01,510 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 06:53:01,511 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:01,511 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649381511 2023-10-30 06:53:01,512 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 06:53:01,513 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-10-30 06:53:01,513 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 06:53:01,515 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x4f18a674 to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:53:01,531 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2aab0976, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:53:01,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:53:01,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:53:01,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:53:01,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:53:01,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:53:01,587 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ee7b1e992877492e9fce4e291cf22d92 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128ee7b1e992877492e9fce4e291cf22d92 2023-10-30 06:53:01,588 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 06:53:01,607 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:53:01,608 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:53:01,622 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:53:01,625 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:53:01,640 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3c0a75cfe8a543a69d1b795121ffc25e first=Optional[r05] last=Optional[r8] 2023-10-30 06:53:01,641 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=51 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3c0a75cfe8a543a69d1b795121ffc25e}] 2023-10-30 06:53:01,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3c0a75cfe8a543a69d1b795121ffc25e for inclusion in 305c2d1857b49805ca7b04e765dbff9e/family1 2023-10-30 06:53:01,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-30 06:53:01,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:53:01,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:53:01,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/3c0a75cfe8a543a69d1b795121ffc25e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dcv842e2vjr76mk5ipa1dhqu02obh02i0l09sb1ipoo9e9uriqo8g48d8p760mei/family1/3c0a75cfe8a543a69d1b795121ffc25e 2023-10-30 06:53:01,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dcv842e2vjr76mk5ipa1dhqu02obh02i0l09sb1ipoo9e9uriqo8g48d8p760mei/family1/3c0a75cfe8a543a69d1b795121ffc25e as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/569b189c4e8a4ba9bf8baecbb86167ce_SeqId_53_ 2023-10-30 06:53:01,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dcv842e2vjr76mk5ipa1dhqu02obh02i0l09sb1ipoo9e9uriqo8g48d8p760mei/family1/3c0a75cfe8a543a69d1b795121ffc25e into 305c2d1857b49805ca7b04e765dbff9e/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/569b189c4e8a4ba9bf8baecbb86167ce_SeqId_53_ - updating store file list. 2023-10-30 06:53:01,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/569b189c4e8a4ba9bf8baecbb86167ce_SeqId_53_ into 305c2d1857b49805ca7b04e765dbff9e/family1 2023-10-30 06:53:01,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dcv842e2vjr76mk5ipa1dhqu02obh02i0l09sb1ipoo9e9uriqo8g48d8p760mei/family1/3c0a75cfe8a543a69d1b795121ffc25e into 305c2d1857b49805ca7b04e765dbff9e/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/family1/569b189c4e8a4ba9bf8baecbb86167ce_SeqId_53_) 2023-10-30 06:53:01,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__dcv842e2vjr76mk5ipa1dhqu02obh02i0l09sb1ipoo9e9uriqo8g48d8p760mei/family1/3c0a75cfe8a543a69d1b795121ffc25e 2023-10-30 06:53:01,679 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 06:53:01,681 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:01,684 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120873fb53a504e4051b6185ebfef8d4f50 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120873fb53a504e4051b6185ebfef8d4f50 2023-10-30 06:53:01,686 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285420f6aa4fd94317aa3599e3f182d104 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285420f6aa4fd94317aa3599e3f182d104 2023-10-30 06:53:01,686 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-10-30 06:53:01,686 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 06:53:01,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:53:01,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:53:01,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 06:53:01,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 06:53:01,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:01,689 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 06:53:01,691 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 181 msec 2023-10-30 06:53:01,804 INFO [Listener at localhost/40811] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=253 (was 210) Potentially hanging thread: RS:0;jenkins-hbase20:40611-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52892 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52840 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2917fba1-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52730 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/cluster_c61b2f97-6a79-fbf9-8770-5add71ee2b48/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2917fba1-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52760 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50449@0x5308628e sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/483025050.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52802 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52796 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/cluster_c61b2f97-6a79-fbf9-8770-5add71ee2b48/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52766 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52868 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50449@0x4f18a674 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/483025050.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52648 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x295b03a3-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_70475656_17 at /127.0.0.1:52822 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x295b03a3-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50449@0x4f18a674-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52778 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52678 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52694 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x295b03a3-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2917fba1-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2917fba1-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52782 [Waiting for operation #23] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52860 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2917fba1-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50449@0x4f18a674-SendThread(127.0.0.1:50449) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50449@0x5308628e-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52752 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:52628 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50449@0x5308628e-SendThread(127.0.0.1:50449) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) - Thread LEAK? -, OpenFileDescriptor=604 (was 478) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=277 (was 252) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=3145 (was 3237) 2023-10-30 06:53:01,817 INFO [Listener at localhost/40811] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=253, OpenFileDescriptor=604, MaxFileDescriptor=60000, SystemLoadAverage=277, ProcessCount=171, AvailableMemoryMB=3144 2023-10-30 06:53:01,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 06:53:01,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:01,823 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 06:53:01,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-10-30 06:53:01,825 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 06:53:01,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 06:53:01,826 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0 2023-10-30 06:53:01,827 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0 empty. 2023-10-30 06:53:01,828 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0 2023-10-30 06:53:01,828 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-10-30 06:53:01,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 06:53:02,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 06:53:02,239 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-30 06:53:02,241 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7877490b556991f4156d5cae8f527ba0, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:53:02,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 06:53:02,654 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:02,655 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 7877490b556991f4156d5cae8f527ba0, disabling compactions & flushes 2023-10-30 06:53:02,655 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:02,655 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:02,655 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. after waiting 0 ms 2023-10-30 06:53:02,655 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:02,655 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:02,655 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:02,659 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 06:53:02,660 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698648782660"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648782660"}]},"ts":"1698648782660"} 2023-10-30 06:53:02,662 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 06:53:02,663 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 06:53:02,664 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648782663"}]},"ts":"1698648782663"} 2023-10-30 06:53:02,666 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-10-30 06:53:02,668 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=7877490b556991f4156d5cae8f527ba0, ASSIGN}] 2023-10-30 06:53:02,670 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=7877490b556991f4156d5cae8f527ba0, ASSIGN 2023-10-30 06:53:02,671 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=7877490b556991f4156d5cae8f527ba0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:53:02,822 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=7877490b556991f4156d5cae8f527ba0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:02,823 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698648782822"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648782822"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648782822"}]},"ts":"1698648782822"} 2023-10-30 06:53:02,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 7877490b556991f4156d5cae8f527ba0, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:53:02,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 06:53:02,977 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:02,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:02,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7877490b556991f4156d5cae8f527ba0, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:53:02,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 7877490b556991f4156d5cae8f527ba0 2023-10-30 06:53:02,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:02,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7877490b556991f4156d5cae8f527ba0 2023-10-30 06:53:02,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7877490b556991f4156d5cae8f527ba0 2023-10-30 06:53:02,984 INFO [StoreOpener-7877490b556991f4156d5cae8f527ba0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7877490b556991f4156d5cae8f527ba0 2023-10-30 06:53:02,986 DEBUG [StoreOpener-7877490b556991f4156d5cae8f527ba0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1 2023-10-30 06:53:02,986 DEBUG [StoreOpener-7877490b556991f4156d5cae8f527ba0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1 2023-10-30 06:53:02,987 INFO [StoreOpener-7877490b556991f4156d5cae8f527ba0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7877490b556991f4156d5cae8f527ba0 columnFamilyName family1 2023-10-30 06:53:02,990 INFO [StoreOpener-7877490b556991f4156d5cae8f527ba0-1] regionserver.HStore(310): Store=7877490b556991f4156d5cae8f527ba0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:53:02,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0 2023-10-30 06:53:02,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0 2023-10-30 06:53:02,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7877490b556991f4156d5cae8f527ba0 2023-10-30 06:53:02,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:53:03,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7877490b556991f4156d5cae8f527ba0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59582737, jitterRate=-0.11214803159236908}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:53:03,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:03,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0., pid=21, masterSystemTime=1698648782977 2023-10-30 06:53:03,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:03,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:03,005 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=7877490b556991f4156d5cae8f527ba0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:03,005 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698648783005"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648783005"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648783005"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648783005"}]},"ts":"1698648783005"} 2023-10-30 06:53:03,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-10-30 06:53:03,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 7877490b556991f4156d5cae8f527ba0, server=jenkins-hbase20.apache.org,40611,1698648765457 in 183 msec 2023-10-30 06:53:03,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-10-30 06:53:03,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=7877490b556991f4156d5cae8f527ba0, ASSIGN in 344 msec 2023-10-30 06:53:03,016 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 06:53:03,017 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648783017"}]},"ts":"1698648783017"} 2023-10-30 06:53:03,019 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-10-30 06:53:03,022 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 06:53:03,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.2030 sec 2023-10-30 06:53:03,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 06:53:03,934 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-10-30 06:53:03,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:03,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:03,974 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:03,974 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:03,975 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:53:03,975 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:03,976 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:03,976 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:03,976 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:03,976 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:03,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:03,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:03,977 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:03,977 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:03,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:03,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:03,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:03,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:03,978 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:03,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:03,978 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:53:03,978 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:03,979 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:53:03,979 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:03,979 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:03,979 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:03,979 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. started... 2023-10-30 06:53:03,980 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7877490b556991f4156d5cae8f527ba0 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 06:53:04,407 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511302ee18ec128534103822f4ccfda5be634 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511302ee18ec128534103822f4ccfda5be634 2023-10-30 06:53:04,812 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/d0b3e8c237094a1db5956cba8acd5ed4 2023-10-30 06:53:04,819 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/d0b3e8c237094a1db5956cba8acd5ed4 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/d0b3e8c237094a1db5956cba8acd5ed4 2023-10-30 06:53:04,826 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/d0b3e8c237094a1db5956cba8acd5ed4, entries=1000, sequenceid=5, filesize=166.0 K 2023-10-30 06:53:04,827 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 7877490b556991f4156d5cae8f527ba0 in 848ms, sequenceid=5, compaction requested=false 2023-10-30 06:53:04,827 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:04,828 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:04,828 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:04,828 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:04,828 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:04,828 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,828 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:53:04,828 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:53:04,829 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,829 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:04,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:04,830 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,830 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:04,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:04,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:04,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:04,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:53:04,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29f2a8ce[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:04,831 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:04,831 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,832 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,832 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:04,832 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,832 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:04,832 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:53:04,832 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:04,833 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,833 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:53:04,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:04,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:04,833 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:04,834 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:53:04,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:04,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:04,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:04,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:04,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:04,836 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:53:04,836 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:04,836 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:04,836 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,836 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:04,837 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,837 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:04,837 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:04,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:04,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,838 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:04,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:04,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:04,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:04,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,839 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:04,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,841 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:04,841 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:04,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:04,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:04,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:04,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:04,841 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:04,842 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,842 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,842 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,842 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,842 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,842 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,842 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:04,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:04,846 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:04,846 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:04,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:53:04,946 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:04,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:04,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:04,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:04,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,959 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:04,959 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:04,959 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:53:04,959 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:04,960 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,960 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,961 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:04,961 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:04,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:04,961 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:04,961 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:04,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:04,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,962 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,962 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:53:04,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:04,963 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:53:04,963 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:04,963 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:53:04,963 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:04,963 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:04,963 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:04,963 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. started... 2023-10-30 06:53:04,963 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7877490b556991f4156d5cae8f527ba0 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 06:53:05,386 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286a2a6360ab2c4dae80a5733f605f5679 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511286a2a6360ab2c4dae80a5733f605f5679 2023-10-30 06:53:05,793 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/5855e9b10d504c559380a80aad511aad 2023-10-30 06:53:05,801 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/5855e9b10d504c559380a80aad511aad as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/5855e9b10d504c559380a80aad511aad 2023-10-30 06:53:05,809 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/5855e9b10d504c559380a80aad511aad, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 06:53:05,810 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 7877490b556991f4156d5cae8f527ba0 in 847ms, sequenceid=9, compaction requested=false 2023-10-30 06:53:05,810 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:05,811 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:05,811 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:05,811 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:05,811 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,811 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:53:05,811 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:53:05,812 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,812 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:05,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:05,813 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,813 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:05,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:05,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:05,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:05,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:53:05,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fadb481[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:05,814 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:05,814 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,815 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,815 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:05,815 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:53:05,815 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,815 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:05,815 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:05,817 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:53:05,817 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,817 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:05,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:05,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:05,817 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:53:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:05,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:05,820 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:53:05,820 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:05,820 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:05,820 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,820 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:05,821 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,821 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:05,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,822 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:05,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:05,822 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:05,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,823 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,826 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,826 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:05,827 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,827 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:05,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:05,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:05,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:05,827 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:05,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:53:05,827 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,827 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:05,827 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:05,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:05,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:05,827 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,828 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:05,828 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,828 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,928 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:05,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:05,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:05,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:05,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,946 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:05,946 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:05,947 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:53:05,947 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:05,947 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,947 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,949 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:05,949 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:05,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:05,949 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:05,949 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:05,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:05,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,950 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,951 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:53:05,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:05,951 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:53:05,951 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:05,951 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:53:05,952 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:05,952 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:05,952 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:05,952 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. started... 2023-10-30 06:53:05,952 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7877490b556991f4156d5cae8f527ba0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:06,366 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120152bd3dab9860474891c3af4b05c948e2 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120152bd3dab9860474891c3af4b05c948e2 2023-10-30 06:53:06,668 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 06:53:06,774 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/1a69344b5d984bff995b5f4e7f803e25 2023-10-30 06:53:06,788 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/1a69344b5d984bff995b5f4e7f803e25 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/1a69344b5d984bff995b5f4e7f803e25 2023-10-30 06:53:06,798 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/1a69344b5d984bff995b5f4e7f803e25, entries=1, sequenceid=13, filesize=4.9 K 2023-10-30 06:53:06,799 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7877490b556991f4156d5cae8f527ba0 in 847ms, sequenceid=13, compaction requested=true 2023-10-30 06:53:06,800 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:06,800 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:06,800 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:06,800 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:06,800 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,800 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:53:06,800 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:53:06,802 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,802 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:06,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:06,802 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,802 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:06,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:06,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:06,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:06,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:53:06,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c2c25fd[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:06,804 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:06,804 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,805 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,805 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:06,805 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:53:06,805 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:06,806 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,806 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,806 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:06,806 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:53:06,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:06,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:06,806 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:06,807 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:53:06,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:06,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:06,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:06,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:06,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:06,811 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:53:06,811 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:06,811 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:06,811 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,811 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:06,815 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,816 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:06,816 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:06,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:06,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:06,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:06,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:06,817 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:06,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,821 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:06,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,826 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,826 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:06,826 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:06,826 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:06,827 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,827 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:06,827 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,827 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,827 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,827 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:06,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:06,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:06,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:53:06,828 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:06,828 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:06,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:06,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:06,928 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:06,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:06,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:06,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:06,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,940 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:06,940 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:06,941 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:53:06,941 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:06,942 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,942 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,943 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:06,943 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:06,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:06,944 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:06,944 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:06,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:06,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,947 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,947 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:53:06,947 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:06,947 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:53:06,947 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:06,948 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:53:06,948 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:06,948 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:06,948 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:06,948 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. started... 2023-10-30 06:53:06,948 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7877490b556991f4156d5cae8f527ba0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:07,371 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055c4155cfd8e3439da4e5868e58f81148 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512055c4155cfd8e3439da4e5868e58f81148 2023-10-30 06:53:07,386 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/ad0022d9b0464ccfa0ece77d18af96b7 2023-10-30 06:53:07,394 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/ad0022d9b0464ccfa0ece77d18af96b7 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/ad0022d9b0464ccfa0ece77d18af96b7 2023-10-30 06:53:07,403 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/ad0022d9b0464ccfa0ece77d18af96b7, entries=1, sequenceid=17, filesize=4.9 K 2023-10-30 06:53:07,405 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7877490b556991f4156d5cae8f527ba0 in 457ms, sequenceid=17, compaction requested=true 2023-10-30 06:53:07,405 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:07,405 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:07,405 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:07,405 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:07,406 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,406 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:53:07,406 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:53:07,407 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,407 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:07,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:07,407 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,407 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:07,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:07,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:07,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:07,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:53:07,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a8e1f76[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:07,409 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:07,409 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,409 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,410 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:07,410 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:53:07,410 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:07,410 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,410 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:07,411 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:53:07,411 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:07,411 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,411 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:53:07,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:07,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:07,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:07,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:07,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:07,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:07,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:07,415 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:53:07,415 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:07,415 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:07,415 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,415 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:07,417 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,417 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:07,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:07,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,417 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:07,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:07,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:07,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,420 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:07,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,426 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,429 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,429 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:07,429 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:07,429 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,429 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,431 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,431 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,431 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,431 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:07,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:07,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:07,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:07,431 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:07,432 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:07,429 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:07,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:07,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:07,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:53:07,532 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:07,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:07,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:07,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:07,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,545 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:07,545 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:07,545 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:53:07,545 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:07,546 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,546 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,547 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:07,547 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:07,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:07,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,547 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:07,547 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:07,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:07,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,550 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,550 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:53:07,550 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:07,550 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:53:07,550 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:07,551 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:53:07,551 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:07,551 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:07,551 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:07,551 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. started... 2023-10-30 06:53:07,551 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7877490b556991f4156d5cae8f527ba0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:07,592 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285abd9551f9224e779263301823769589 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512285abd9551f9224e779263301823769589 2023-10-30 06:53:08,003 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/02428d8dfa864b1781bbfbae383f57bc 2023-10-30 06:53:08,010 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/02428d8dfa864b1781bbfbae383f57bc as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/02428d8dfa864b1781bbfbae383f57bc 2023-10-30 06:53:08,018 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/02428d8dfa864b1781bbfbae383f57bc, entries=1, sequenceid=21, filesize=4.9 K 2023-10-30 06:53:08,019 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7877490b556991f4156d5cae8f527ba0 in 468ms, sequenceid=21, compaction requested=true 2023-10-30 06:53:08,019 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:08,019 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:08,019 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:08,019 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:08,019 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,020 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:53:08,020 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:53:08,021 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,021 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:08,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:08,021 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,021 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:08,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:08,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:08,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:08,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:53:08,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76066a31[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:08,024 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:08,024 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,025 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,026 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:08,026 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:53:08,026 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,026 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:08,026 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:08,027 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:08,027 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:53:08,027 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:08,027 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:53:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:08,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:08,032 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:53:08,032 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:08,032 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:08,032 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,032 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:08,038 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,038 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:08,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,040 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:08,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:08,041 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:08,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:08,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,042 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:08,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,045 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:08,045 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:08,045 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:08,046 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:08,046 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:08,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:08,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:08,045 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,046 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,046 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,046 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,046 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,047 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:08,047 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:08,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:08,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:08,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:53:08,147 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:08,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:08,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:08,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:08,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,158 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:08,158 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:08,158 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:53:08,158 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:08,159 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,159 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,160 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:08,160 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:08,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:08,160 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:08,160 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:08,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,160 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:08,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,161 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,162 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:53:08,162 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:08,162 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:53:08,162 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:08,162 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:53:08,163 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:08,163 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:08,163 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:08,163 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. started... 2023-10-30 06:53:08,163 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7877490b556991f4156d5cae8f527ba0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:08,582 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123118d27abfb25b4d6fafcf95f5b5b11074 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123118d27abfb25b4d6fafcf95f5b5b11074 2023-10-30 06:53:08,989 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/f16126022cc848c9b4668c35602c64ec 2023-10-30 06:53:08,998 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/f16126022cc848c9b4668c35602c64ec as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/f16126022cc848c9b4668c35602c64ec 2023-10-30 06:53:09,005 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/f16126022cc848c9b4668c35602c64ec, entries=1, sequenceid=25, filesize=4.9 K 2023-10-30 06:53:09,006 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7877490b556991f4156d5cae8f527ba0 in 843ms, sequenceid=25, compaction requested=true 2023-10-30 06:53:09,006 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:09,006 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:09,006 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:09,006 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:09,006 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,006 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:53:09,006 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:53:09,008 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,008 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:09,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:09,008 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,008 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:09,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:09,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:09,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:09,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:53:09,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fdc1cc[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:09,009 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:09,010 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,010 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,011 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:09,011 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:53:09,011 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,011 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:09,011 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:09,012 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,012 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:53:09,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:09,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:09,012 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:09,012 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:53:09,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:09,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:09,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:09,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:09,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:09,015 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:53:09,015 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:09,015 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:09,015 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,015 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:09,026 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,026 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:09,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,026 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:09,027 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:09,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,028 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:09,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,032 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:09,032 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:09,032 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:09,032 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:09,032 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,032 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,033 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,033 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,033 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:09,033 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:53:09,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:09,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:09,035 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:09,035 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:09,135 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:09,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:09,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:09,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:09,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,148 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:09,148 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:09,148 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:53:09,148 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:09,149 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,149 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,150 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,150 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:09,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:09,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:09,150 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,150 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:09,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:09,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,151 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,151 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:53:09,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,151 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:53:09,151 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:09,152 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:53:09,152 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:09,152 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:09,152 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:09,152 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. started... 2023-10-30 06:53:09,152 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7877490b556991f4156d5cae8f527ba0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:09,572 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101509fbe87d0174c52b33f1ac7405d435f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101509fbe87d0174c52b33f1ac7405d435f 2023-10-30 06:53:09,580 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/19285b18af914b26855a0e3d7b2fa21e 2023-10-30 06:53:09,588 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/19285b18af914b26855a0e3d7b2fa21e as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/19285b18af914b26855a0e3d7b2fa21e 2023-10-30 06:53:09,595 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/19285b18af914b26855a0e3d7b2fa21e, entries=1, sequenceid=29, filesize=4.9 K 2023-10-30 06:53:09,596 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7877490b556991f4156d5cae8f527ba0 in 444ms, sequenceid=29, compaction requested=true 2023-10-30 06:53:09,597 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:09,597 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:09,597 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:09,597 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:09,597 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,597 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:53:09,597 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:53:09,598 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,598 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:09,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:09,599 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:09,599 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:09,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:53:09,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59230f63[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:09,600 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:09,600 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,601 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,601 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:09,601 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:53:09,601 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,601 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:09,601 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:09,602 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:53:09,602 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,602 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:09,602 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:53:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:09,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:09,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:09,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:09,606 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:53:09,606 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:09,606 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:09,606 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,606 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:09,607 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,607 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,607 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:09,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:09,608 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:09,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:09,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,609 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:09,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,611 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,611 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,611 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:09,611 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:09,611 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:09,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:53:09,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:09,612 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,612 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,612 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,612 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:09,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:09,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:09,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:09,612 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:09,613 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:09,613 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:09,713 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:09,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:09,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:09,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:09,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,728 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:09,728 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:09,729 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:53:09,729 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:09,729 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,729 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,730 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:09,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:09,730 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,731 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:09,731 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:09,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,731 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,732 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:53:09,732 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:09,733 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:53:09,733 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:09,733 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:53:09,734 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:09,734 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:09,734 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:09,734 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. started... 2023-10-30 06:53:09,734 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7877490b556991f4156d5cae8f527ba0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:09,752 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103158d83ff7ee54728a9393310e071dd14 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103158d83ff7ee54728a9393310e071dd14 2023-10-30 06:53:10,159 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/c31c293fd10142ed80a8350162b5e587 2023-10-30 06:53:10,166 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/c31c293fd10142ed80a8350162b5e587 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/c31c293fd10142ed80a8350162b5e587 2023-10-30 06:53:10,173 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/c31c293fd10142ed80a8350162b5e587, entries=1, sequenceid=33, filesize=4.9 K 2023-10-30 06:53:10,175 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7877490b556991f4156d5cae8f527ba0 in 441ms, sequenceid=33, compaction requested=true 2023-10-30 06:53:10,175 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:10,175 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:10,175 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:10,175 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:10,175 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,175 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:53:10,175 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:53:10,176 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,177 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:10,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:10,177 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,177 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:10,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:10,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:10,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:53:10,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63ecce9e[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:10,179 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:10,179 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,181 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,181 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:10,181 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:53:10,181 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:10,181 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,181 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:10,182 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:53:10,182 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,182 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:10,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:10,182 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:53:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:10,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:10,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:10,185 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:53:10,185 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:10,185 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:10,185 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,185 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:10,186 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,186 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:10,186 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:10,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:10,187 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,188 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,190 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:10,190 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:10,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:10,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:53:10,190 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:10,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:10,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:10,190 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,190 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,190 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,190 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,190 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,190 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,190 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:10,191 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:10,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:10,191 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:10,291 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:10,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:10,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:10,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:10,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,303 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:10,304 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:10,304 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:53:10,304 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:10,305 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,305 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,306 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,306 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:10,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:10,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:10,306 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:10,306 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:10,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:10,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,307 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,307 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:53:10,307 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:10,308 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:53:10,308 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:10,308 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:53:10,310 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:10,310 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:10,310 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:10,310 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. started... 2023-10-30 06:53:10,310 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7877490b556991f4156d5cae8f527ba0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:10,738 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907aeccb6533ab74d07be3398ee1678f063 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907aeccb6533ab74d07be3398ee1678f063 2023-10-30 06:53:11,148 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/4a636df28c744696bb4cf10fb7b89604 2023-10-30 06:53:11,154 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/4a636df28c744696bb4cf10fb7b89604 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4a636df28c744696bb4cf10fb7b89604 2023-10-30 06:53:11,160 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4a636df28c744696bb4cf10fb7b89604, entries=1, sequenceid=37, filesize=4.9 K 2023-10-30 06:53:11,161 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7877490b556991f4156d5cae8f527ba0 in 851ms, sequenceid=37, compaction requested=true 2023-10-30 06:53:11,162 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:11,162 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:11,162 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:11,162 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:11,162 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,162 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:53:11,162 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:53:11,163 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,163 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:11,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:11,163 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,163 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:11,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:11,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:11,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:11,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:53:11,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@267e7730[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:11,165 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:11,165 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,166 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,166 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,166 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:11,166 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:11,166 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:53:11,166 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:11,167 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:53:11,167 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,167 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:11,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:11,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:11,167 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:53:11,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:11,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:11,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:11,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:11,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:11,171 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:53:11,171 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:11,171 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:11,171 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,171 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:11,176 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,176 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:11,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,176 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:11,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:11,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:11,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:11,177 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:11,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:11,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,180 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:11,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,190 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,190 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:11,190 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:11,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:11,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:11,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:11,190 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:11,190 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,190 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:11,192 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:11,191 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:11,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:11,192 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:11,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:53:11,192 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,193 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,193 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,293 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:11,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:11,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:11,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:11,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,309 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:11,309 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:11,310 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:53:11,310 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:11,311 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,311 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,312 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:11,312 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:11,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:11,312 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:11,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,313 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:11,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:11,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,313 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,314 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:53:11,314 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:11,314 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:53:11,314 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:11,315 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:53:11,315 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:11,315 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:11,315 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:11,316 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. started... 2023-10-30 06:53:11,316 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7877490b556991f4156d5cae8f527ba0 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:11,742 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ede22826948049f3a43d0c57fae979de to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120ede22826948049f3a43d0c57fae979de 2023-10-30 06:53:12,151 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/0ff9bfa7bbd342bd91ede6bdd4a9942c 2023-10-30 06:53:12,166 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/0ff9bfa7bbd342bd91ede6bdd4a9942c as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/0ff9bfa7bbd342bd91ede6bdd4a9942c 2023-10-30 06:53:12,173 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/0ff9bfa7bbd342bd91ede6bdd4a9942c, entries=1, sequenceid=41, filesize=4.9 K 2023-10-30 06:53:12,175 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7877490b556991f4156d5cae8f527ba0 in 859ms, sequenceid=41, compaction requested=true 2023-10-30 06:53:12,175 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:12,175 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:12,175 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:12,175 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:12,175 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,175 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:53:12,175 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:53:12,180 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,180 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:12,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:12,181 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,181 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:12,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:12,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:12,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:12,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:53:12,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c673192[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:12,182 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:12,182 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,193 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,193 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:12,193 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:53:12,193 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:12,193 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,193 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:12,198 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,198 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:53:12,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:12,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:53:12,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:12,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:12,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:12,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:12,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:12,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:12,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:12,202 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:53:12,202 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:12,202 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:12,202 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,202 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:12,204 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,204 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:12,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,204 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:12,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:12,205 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:12,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,207 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:12,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,210 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,210 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:12,210 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,211 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:12,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:53:12,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:12,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:12,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:12,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:12,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 06:53:12,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:12,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:12,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:12,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,212 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,212 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:12,212 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:12,312 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:12,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:12,320 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-10-30 06:53:12,325 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 06:53:12,326 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 06:53:12,328 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:12,328 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649392328 2023-10-30 06:53:12,329 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 06:53:12,331 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-10-30 06:53:12,331 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:53:12,333 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x5e7573fe to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:53:12,341 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c6721ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:53:12,342 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:53:13,184 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103eb37009fd2b34d19b226074b8faf7dcb to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103eb37009fd2b34d19b226074b8faf7dcb 2023-10-30 06:53:13,185 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:53:13,200 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:53:13,202 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:53:13,210 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:53:13,211 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:53:13,223 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/72d9d95e4ad5466f991569b962e52b10 first=Optional[r5] last=Optional[r6] 2023-10-30 06:53:13,224 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/72d9d95e4ad5466f991569b962e52b10}] 2023-10-30 06:53:13,229 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/72d9d95e4ad5466f991569b962e52b10 for inclusion in 7877490b556991f4156d5cae8f527ba0/family1 2023-10-30 06:53:13,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-10-30 06:53:13,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:53:13,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:13,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/72d9d95e4ad5466f991569b962e52b10 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3rtgb1lesigr9imk12sbnvt60vmrmr43ng2o8gpbsfbau1aacq2hi64qauhirsu8/family1/72d9d95e4ad5466f991569b962e52b10 2023-10-30 06:53:13,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3rtgb1lesigr9imk12sbnvt60vmrmr43ng2o8gpbsfbau1aacq2hi64qauhirsu8/family1/72d9d95e4ad5466f991569b962e52b10 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4dfe332e1ff649ee9ed06556a352d841_SeqId_44_ 2023-10-30 06:53:13,237 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3rtgb1lesigr9imk12sbnvt60vmrmr43ng2o8gpbsfbau1aacq2hi64qauhirsu8/family1/72d9d95e4ad5466f991569b962e52b10 into 7877490b556991f4156d5cae8f527ba0/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4dfe332e1ff649ee9ed06556a352d841_SeqId_44_ - updating store file list. 2023-10-30 06:53:13,241 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4dfe332e1ff649ee9ed06556a352d841_SeqId_44_ into 7877490b556991f4156d5cae8f527ba0/family1 2023-10-30 06:53:13,241 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3rtgb1lesigr9imk12sbnvt60vmrmr43ng2o8gpbsfbau1aacq2hi64qauhirsu8/family1/72d9d95e4ad5466f991569b962e52b10 into 7877490b556991f4156d5cae8f527ba0/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4dfe332e1ff649ee9ed06556a352d841_SeqId_44_) 2023-10-30 06:53:13,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3rtgb1lesigr9imk12sbnvt60vmrmr43ng2o8gpbsfbau1aacq2hi64qauhirsu8/family1/72d9d95e4ad5466f991569b962e52b10 2023-10-30 06:53:13,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 06:53:13,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 06:53:13,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(1912): 7877490b556991f4156d5cae8f527ba0/family1 is initiating minor compaction 2023-10-30 06:53:13,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@762cb68a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-30 06:53:13,246 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7877490b556991f4156d5cae8f527ba0/family1 in testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:13,246 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/5855e9b10d504c559380a80aad511aad, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/1a69344b5d984bff995b5f4e7f803e25, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/ad0022d9b0464ccfa0ece77d18af96b7, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/02428d8dfa864b1781bbfbae383f57bc, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/f16126022cc848c9b4668c35602c64ec, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/19285b18af914b26855a0e3d7b2fa21e, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/c31c293fd10142ed80a8350162b5e587, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4a636df28c744696bb4cf10fb7b89604, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/0ff9bfa7bbd342bd91ede6bdd4a9942c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4dfe332e1ff649ee9ed06556a352d841_SeqId_44_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp, totalSize=49.7 K 2023-10-30 06:53:13,247 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 5855e9b10d504c559380a80aad511aad, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 06:53:13,247 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 1a69344b5d984bff995b5f4e7f803e25, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 06:53:13,247 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting ad0022d9b0464ccfa0ece77d18af96b7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 06:53:13,247 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 02428d8dfa864b1781bbfbae383f57bc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 06:53:13,247 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting f16126022cc848c9b4668c35602c64ec, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 06:53:13,247 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 19285b18af914b26855a0e3d7b2fa21e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 06:53:13,247 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting c31c293fd10142ed80a8350162b5e587, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 06:53:13,247 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 4a636df28c744696bb4cf10fb7b89604, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 06:53:13,247 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 0ff9bfa7bbd342bd91ede6bdd4a9942c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 06:53:13,248 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 4dfe332e1ff649ee9ed06556a352d841_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 06:53:13,249 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:53:13,250 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:13,251 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101509fbe87d0174c52b33f1ac7405d435f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101509fbe87d0174c52b33f1ac7405d435f 2023-10-30 06:53:13,253 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103158d83ff7ee54728a9393310e071dd14 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103158d83ff7ee54728a9393310e071dd14 2023-10-30 06:53:13,253 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-10-30 06:53:13,253 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-10-30 06:53:13,253 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:53:13,253 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:53:13,281 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7877490b556991f4156d5cae8f527ba0#family1#compaction#22 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:53:13,701 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/e33e1def85ab436b947514a136b9878f as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/e33e1def85ab436b947514a136b9878f 2023-10-30 06:53:13,704 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ca2ac18c85984b4e98f64e391b9bb0e9 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231ca2ac18c85984b4e98f64e391b9bb0e9 2023-10-30 06:53:13,706 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:53:13,708 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 7877490b556991f4156d5cae8f527ba0/family1 of 7877490b556991f4156d5cae8f527ba0 into e33e1def85ab436b947514a136b9878f(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:53:13,708 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:13,708 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698648793246; duration=0sec 2023-10-30 06:53:13,708 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:13,735 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/15642b85369843e9a792735b78ddc71d first=Optional[r1] last=Optional[r4] 2023-10-30 06:53:13,736 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/15642b85369843e9a792735b78ddc71d}] 2023-10-30 06:53:13,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/15642b85369843e9a792735b78ddc71d for inclusion in 7877490b556991f4156d5cae8f527ba0/family1 2023-10-30 06:53:13,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-10-30 06:53:13,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:53:13,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:13,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/5855e9b10d504c559380a80aad511aad, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/1a69344b5d984bff995b5f4e7f803e25, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/ad0022d9b0464ccfa0ece77d18af96b7, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/02428d8dfa864b1781bbfbae383f57bc, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/f16126022cc848c9b4668c35602c64ec, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/19285b18af914b26855a0e3d7b2fa21e, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/c31c293fd10142ed80a8350162b5e587, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4a636df28c744696bb4cf10fb7b89604, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/0ff9bfa7bbd342bd91ede6bdd4a9942c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4dfe332e1ff649ee9ed06556a352d841_SeqId_44_] to archive 2023-10-30 06:53:13,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/15642b85369843e9a792735b78ddc71d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c1eb3bc4q5s3s337ktuckkrata0mfmn5q6p02dnor0s1a4an2jc0pg8e7612nrsi/family1/15642b85369843e9a792735b78ddc71d 2023-10-30 06:53:13,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:13,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/5855e9b10d504c559380a80aad511aad to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/5855e9b10d504c559380a80aad511aad 2023-10-30 06:53:13,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c1eb3bc4q5s3s337ktuckkrata0mfmn5q6p02dnor0s1a4an2jc0pg8e7612nrsi/family1/15642b85369843e9a792735b78ddc71d as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4207e64f538b430c8439c66b85905958_SeqId_47_ 2023-10-30 06:53:13,756 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c1eb3bc4q5s3s337ktuckkrata0mfmn5q6p02dnor0s1a4an2jc0pg8e7612nrsi/family1/15642b85369843e9a792735b78ddc71d into 7877490b556991f4156d5cae8f527ba0/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4207e64f538b430c8439c66b85905958_SeqId_47_ - updating store file list. 2023-10-30 06:53:13,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/1a69344b5d984bff995b5f4e7f803e25 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/1a69344b5d984bff995b5f4e7f803e25 2023-10-30 06:53:13,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/ad0022d9b0464ccfa0ece77d18af96b7 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/ad0022d9b0464ccfa0ece77d18af96b7 2023-10-30 06:53:13,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/02428d8dfa864b1781bbfbae383f57bc to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/02428d8dfa864b1781bbfbae383f57bc 2023-10-30 06:53:13,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/f16126022cc848c9b4668c35602c64ec to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/f16126022cc848c9b4668c35602c64ec 2023-10-30 06:53:13,763 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4207e64f538b430c8439c66b85905958_SeqId_47_ into 7877490b556991f4156d5cae8f527ba0/family1 2023-10-30 06:53:13,764 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c1eb3bc4q5s3s337ktuckkrata0mfmn5q6p02dnor0s1a4an2jc0pg8e7612nrsi/family1/15642b85369843e9a792735b78ddc71d into 7877490b556991f4156d5cae8f527ba0/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4207e64f538b430c8439c66b85905958_SeqId_47_) 2023-10-30 06:53:13,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c1eb3bc4q5s3s337ktuckkrata0mfmn5q6p02dnor0s1a4an2jc0pg8e7612nrsi/family1/15642b85369843e9a792735b78ddc71d 2023-10-30 06:53:13,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 06:53:13,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/19285b18af914b26855a0e3d7b2fa21e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/19285b18af914b26855a0e3d7b2fa21e 2023-10-30 06:53:13,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 06:53:13,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(1912): 7877490b556991f4156d5cae8f527ba0/family1 is initiating minor compaction (all files) 2023-10-30 06:53:13,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@32c2dfaa; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:13,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/c31c293fd10142ed80a8350162b5e587 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/c31c293fd10142ed80a8350162b5e587 2023-10-30 06:53:13,766 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7877490b556991f4156d5cae8f527ba0/family1 in testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:53:13,766 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/d0b3e8c237094a1db5956cba8acd5ed4, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/e33e1def85ab436b947514a136b9878f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4207e64f538b430c8439c66b85905958_SeqId_47_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp, totalSize=178.1 K 2023-10-30 06:53:13,767 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting d0b3e8c237094a1db5956cba8acd5ed4, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878849956 2023-10-30 06:53:13,767 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting e33e1def85ab436b947514a136b9878f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621249956 2023-10-30 06:53:13,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4a636df28c744696bb4cf10fb7b89604 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4a636df28c744696bb4cf10fb7b89604 2023-10-30 06:53:13,768 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 4207e64f538b430c8439c66b85905958_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965249956 2023-10-30 06:53:13,768 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:53:13,770 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:13,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/0ff9bfa7bbd342bd91ede6bdd4a9942c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/0ff9bfa7bbd342bd91ede6bdd4a9942c 2023-10-30 06:53:13,772 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120152bd3dab9860474891c3af4b05c948e2 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120152bd3dab9860474891c3af4b05c948e2 2023-10-30 06:53:13,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4dfe332e1ff649ee9ed06556a352d841_SeqId_44_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4dfe332e1ff649ee9ed06556a352d841_SeqId_44_ 2023-10-30 06:53:13,774 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512055c4155cfd8e3439da4e5868e58f81148 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512055c4155cfd8e3439da4e5868e58f81148 2023-10-30 06:53:13,775 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512285abd9551f9224e779263301823769589 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512285abd9551f9224e779263301823769589 2023-10-30 06:53:13,787 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123118d27abfb25b4d6fafcf95f5b5b11074 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123118d27abfb25b4d6fafcf95f5b5b11074 2023-10-30 06:53:13,787 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-10-30 06:53:13,788 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-10-30 06:53:13,788 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:53:13,788 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:53:13,795 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7877490b556991f4156d5cae8f527ba0#family1#compaction#23 average throughput is 11.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:53:13,875 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e686fbe94ef741a3af34785a7f17fa99 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130e686fbe94ef741a3af34785a7f17fa99 2023-10-30 06:53:13,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:53:13,915 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/96533bc3556842baa58a17c67e47e042 first=Optional[r00] last=Optional[r8] 2023-10-30 06:53:13,916 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/96533bc3556842baa58a17c67e47e042}] 2023-10-30 06:53:13,919 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/96533bc3556842baa58a17c67e47e042 for inclusion in 7877490b556991f4156d5cae8f527ba0/family1 2023-10-30 06:53:13,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-10-30 06:53:13,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:53:13,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:13,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/96533bc3556842baa58a17c67e47e042 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p0u8cp5nh9inb61kh6jq8e9h9aeaqrqpb8jm4pv86jplqj3njl4jo7k0rp7nqtft/family1/96533bc3556842baa58a17c67e47e042 2023-10-30 06:53:13,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p0u8cp5nh9inb61kh6jq8e9h9aeaqrqpb8jm4pv86jplqj3njl4jo7k0rp7nqtft/family1/96533bc3556842baa58a17c67e47e042 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/d7258c2854c047c791f3322408408abe_SeqId_49_ 2023-10-30 06:53:13,929 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p0u8cp5nh9inb61kh6jq8e9h9aeaqrqpb8jm4pv86jplqj3njl4jo7k0rp7nqtft/family1/96533bc3556842baa58a17c67e47e042 into 7877490b556991f4156d5cae8f527ba0/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/d7258c2854c047c791f3322408408abe_SeqId_49_ - updating store file list. 2023-10-30 06:53:13,935 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/d7258c2854c047c791f3322408408abe_SeqId_49_ into 7877490b556991f4156d5cae8f527ba0/family1 2023-10-30 06:53:13,936 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p0u8cp5nh9inb61kh6jq8e9h9aeaqrqpb8jm4pv86jplqj3njl4jo7k0rp7nqtft/family1/96533bc3556842baa58a17c67e47e042 into 7877490b556991f4156d5cae8f527ba0/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/d7258c2854c047c791f3322408408abe_SeqId_49_) 2023-10-30 06:53:13,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p0u8cp5nh9inb61kh6jq8e9h9aeaqrqpb8jm4pv86jplqj3njl4jo7k0rp7nqtft/family1/96533bc3556842baa58a17c67e47e042 2023-10-30 06:53:13,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:53:13,940 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:13,942 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120ede22826948049f3a43d0c57fae979de to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120ede22826948049f3a43d0c57fae979de 2023-10-30 06:53:13,944 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511286a2a6360ab2c4dae80a5733f605f5679 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511286a2a6360ab2c4dae80a5733f605f5679 2023-10-30 06:53:13,945 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511302ee18ec128534103822f4ccfda5be634 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511302ee18ec128534103822f4ccfda5be634 2023-10-30 06:53:13,946 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-10-30 06:53:13,946 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 06:53:13,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:53:13,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:53:13,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:53:13,947 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:53:13,947 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:13,948 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 06:53:13,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.6260 sec 2023-10-30 06:53:14,125 INFO [Listener at localhost/40811] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=259 (was 253) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:49666 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:49586 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50449@0x5e7573fe-SendThread(127.0.0.1:50449) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:44650 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:49724 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d5069cb-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2a1b55ca-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d5069cb-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50449@0x5e7573fe-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:49726 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:49574 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512315a5c757addf248458e45a09837e5cdcd_del java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: hconnection-0x5d5069cb-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-352835126-148.251.75.209-1698648760718:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: hconnection-0x5d5069cb-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/2e1b3c1a22b54836b80ab0564ca1933d block BP-352835126-148.251.75.209-1698648760718:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: Thread-483 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:49558 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:49794 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d5069cb-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:44634 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:44668 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_70475656_17 at /127.0.0.1:49808 [Receiving block BP-352835126-148.251.75.209-1698648760718:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:49792 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:49642 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50449@0x5e7573fe sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/483025050.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-352835126-148.251.75.209-1698648760718:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d5069cb-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:49672 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5d5069cb-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2040316205_17 at /127.0.0.1:49654 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=611 (was 604) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=314 (was 277) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=2863 (was 3144) 2023-10-30 06:53:14,142 INFO [Listener at localhost/40811] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=259, OpenFileDescriptor=611, MaxFileDescriptor=60000, SystemLoadAverage=314, ProcessCount=171, AvailableMemoryMB=2863 2023-10-30 06:53:14,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 06:53:14,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:14,150 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 06:53:14,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-10-30 06:53:14,152 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 06:53:14,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 06:53:14,170 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6 2023-10-30 06:53:14,171 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6 empty. 2023-10-30 06:53:14,172 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6 2023-10-30 06:53:14,172 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-10-30 06:53:14,205 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-30 06:53:14,208 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 08334b8a91b43e79f682fea554e7c5b6, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:53:14,255 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:14,255 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 08334b8a91b43e79f682fea554e7c5b6, disabling compactions & flushes 2023-10-30 06:53:14,255 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:14,255 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:14,256 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. after waiting 0 ms 2023-10-30 06:53:14,256 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:14,256 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:14,256 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:14,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 06:53:14,260 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 06:53:14,261 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698648794261"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648794261"}]},"ts":"1698648794261"} 2023-10-30 06:53:14,263 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 06:53:14,265 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 06:53:14,265 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648794265"}]},"ts":"1698648794265"} 2023-10-30 06:53:14,267 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-10-30 06:53:14,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=08334b8a91b43e79f682fea554e7c5b6, ASSIGN}] 2023-10-30 06:53:14,274 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=08334b8a91b43e79f682fea554e7c5b6, ASSIGN 2023-10-30 06:53:14,276 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=08334b8a91b43e79f682fea554e7c5b6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:53:14,427 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=08334b8a91b43e79f682fea554e7c5b6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:14,427 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698648794427"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648794427"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648794427"}]},"ts":"1698648794427"} 2023-10-30 06:53:14,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 08334b8a91b43e79f682fea554e7c5b6, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:53:14,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 06:53:14,582 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:14,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:14,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 08334b8a91b43e79f682fea554e7c5b6, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:53:14,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 08334b8a91b43e79f682fea554e7c5b6 2023-10-30 06:53:14,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:14,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 08334b8a91b43e79f682fea554e7c5b6 2023-10-30 06:53:14,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 08334b8a91b43e79f682fea554e7c5b6 2023-10-30 06:53:14,589 INFO [StoreOpener-08334b8a91b43e79f682fea554e7c5b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 08334b8a91b43e79f682fea554e7c5b6 2023-10-30 06:53:14,591 DEBUG [StoreOpener-08334b8a91b43e79f682fea554e7c5b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1 2023-10-30 06:53:14,591 DEBUG [StoreOpener-08334b8a91b43e79f682fea554e7c5b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1 2023-10-30 06:53:14,591 INFO [StoreOpener-08334b8a91b43e79f682fea554e7c5b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08334b8a91b43e79f682fea554e7c5b6 columnFamilyName family1 2023-10-30 06:53:14,593 INFO [StoreOpener-08334b8a91b43e79f682fea554e7c5b6-1] regionserver.HStore(310): Store=08334b8a91b43e79f682fea554e7c5b6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:53:14,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6 2023-10-30 06:53:14,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6 2023-10-30 06:53:14,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 08334b8a91b43e79f682fea554e7c5b6 2023-10-30 06:53:14,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:53:14,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 08334b8a91b43e79f682fea554e7c5b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65878465, jitterRate=-0.018334373831748962}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:53:14,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:14,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6., pid=25, masterSystemTime=1698648794582 2023-10-30 06:53:14,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:14,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:14,604 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=08334b8a91b43e79f682fea554e7c5b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:14,605 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698648794604"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648794604"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648794604"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648794604"}]},"ts":"1698648794604"} 2023-10-30 06:53:14,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-10-30 06:53:14,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 08334b8a91b43e79f682fea554e7c5b6, server=jenkins-hbase20.apache.org,40611,1698648765457 in 176 msec 2023-10-30 06:53:14,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-10-30 06:53:14,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=08334b8a91b43e79f682fea554e7c5b6, ASSIGN in 337 msec 2023-10-30 06:53:14,611 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 06:53:14,611 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648794611"}]},"ts":"1698648794611"} 2023-10-30 06:53:14,613 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-10-30 06:53:14,615 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 06:53:14,616 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 470 msec 2023-10-30 06:53:14,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 06:53:14,762 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-10-30 06:53:14,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:14,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:14,797 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:14,797 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:14,797 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:14,797 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:14,797 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:14,797 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:14,798 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:14,798 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:14,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:14,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:14,799 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:14,799 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:14,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:14,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:14,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:14,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:14,800 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:14,800 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:14,800 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:14,800 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:14,800 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:14,800 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:14,800 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:14,800 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:14,800 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. started... 2023-10-30 06:53:14,801 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 08334b8a91b43e79f682fea554e7c5b6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 06:53:15,077 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/.tmp/family1/2e1b3c1a22b54836b80ab0564ca1933d as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/2e1b3c1a22b54836b80ab0564ca1933d 2023-10-30 06:53:15,082 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7877490b556991f4156d5cae8f527ba0/family1 of 7877490b556991f4156d5cae8f527ba0 into 2e1b3c1a22b54836b80ab0564ca1933d(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:53:15,082 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:53:15,083 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698648793766; duration=1sec 2023-10-30 06:53:15,083 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:15,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/d0b3e8c237094a1db5956cba8acd5ed4, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/e33e1def85ab436b947514a136b9878f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4207e64f538b430c8439c66b85905958_SeqId_47_] to archive 2023-10-30 06:53:15,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:15,145 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/d0b3e8c237094a1db5956cba8acd5ed4 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/d0b3e8c237094a1db5956cba8acd5ed4 2023-10-30 06:53:15,148 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/e33e1def85ab436b947514a136b9878f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/e33e1def85ab436b947514a136b9878f 2023-10-30 06:53:15,150 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4207e64f538b430c8439c66b85905958_SeqId_47_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/family1/4207e64f538b430c8439c66b85905958_SeqId_47_ 2023-10-30 06:53:15,226 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511302969682644e34bc2bf455b92ad81bd15 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511302969682644e34bc2bf455b92ad81bd15 2023-10-30 06:53:15,632 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/b9c10f92e8b54843a46123c40694a3ee 2023-10-30 06:53:15,643 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/b9c10f92e8b54843a46123c40694a3ee as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/b9c10f92e8b54843a46123c40694a3ee 2023-10-30 06:53:15,650 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/b9c10f92e8b54843a46123c40694a3ee, entries=1000, sequenceid=5, filesize=165.1 K 2023-10-30 06:53:15,651 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 08334b8a91b43e79f682fea554e7c5b6 in 850ms, sequenceid=5, compaction requested=false 2023-10-30 06:53:15,652 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:15,652 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:15,652 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:15,652 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:15,652 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:15,652 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,652 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:15,652 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:15,654 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,654 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:15,654 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,654 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:15,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:15,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:15,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@dfe776a[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:15,656 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:15,656 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,656 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,657 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:15,657 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:15,657 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:15,657 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,657 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:15,658 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:15,658 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:15,658 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,658 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:15,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:15,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:15,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:15,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:15,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:15,660 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:15,660 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:15,660 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:15,660 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,660 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:15,661 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,661 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:15,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:15,661 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:15,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:15,662 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:15,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:15,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:15,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,663 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:15,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,664 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,664 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,664 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:15,664 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:15,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:15,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:15,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:15,665 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:15,665 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,664 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:15,665 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:15,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:15,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 06:53:15,665 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:15,665 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,665 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:15,665 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,766 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:15,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:15,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:15,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:15,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,774 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:15,774 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:15,774 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:15,774 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:15,775 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,775 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,776 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,776 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:15,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:15,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:15,776 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:15,776 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:15,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:15,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,777 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,777 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:15,777 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:15,777 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:15,777 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:15,777 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:15,777 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:15,777 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:15,777 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:15,777 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. started... 2023-10-30 06:53:15,777 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 08334b8a91b43e79f682fea554e7c5b6 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 06:53:16,199 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286e85233fe77b4388a8d9867c52d4e28f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511286e85233fe77b4388a8d9867c52d4e28f 2023-10-30 06:53:16,608 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/f480d45078b04918a7eb61e1eb84de3e 2023-10-30 06:53:16,623 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/f480d45078b04918a7eb61e1eb84de3e as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/f480d45078b04918a7eb61e1eb84de3e 2023-10-30 06:53:16,632 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/f480d45078b04918a7eb61e1eb84de3e, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 06:53:16,633 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 08334b8a91b43e79f682fea554e7c5b6 in 856ms, sequenceid=9, compaction requested=false 2023-10-30 06:53:16,633 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:16,633 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:16,634 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:16,634 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:16,634 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,634 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:16,634 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:16,635 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,635 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:16,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:16,636 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,636 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:16,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:16,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:16,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:16,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:16,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@863c075[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:16,637 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:16,637 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,638 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,638 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,638 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:16,638 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:16,638 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:16,638 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:16,640 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:16,640 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,640 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:16,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:16,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:16,640 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:16,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:16,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:16,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:16,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:16,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:16,643 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:16,643 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:16,643 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:16,643 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,643 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:16,651 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,651 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,651 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:16,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:16,652 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:16,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:16,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,653 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:16,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,659 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:16,659 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,659 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,659 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:16,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:16,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:16,659 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:16,659 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,660 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:16,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:16,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 06:53:16,660 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,660 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:16,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:16,660 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,661 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:16,661 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:16,761 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:16,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:16,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:16,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:16,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,771 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:16,771 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:16,771 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:16,771 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:16,772 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,772 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,773 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:16,773 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:16,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:16,773 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:16,773 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:16,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:16,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,774 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,774 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:16,774 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:16,774 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:16,774 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:16,774 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:16,774 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:16,774 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:16,774 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:16,774 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. started... 2023-10-30 06:53:16,774 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 08334b8a91b43e79f682fea554e7c5b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:17,197 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120161385c332a794356b6ffcae57d854443 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120161385c332a794356b6ffcae57d854443 2023-10-30 06:53:17,205 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/ecc5f9dec9a645a781f2e008b8b97652 2023-10-30 06:53:17,213 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/ecc5f9dec9a645a781f2e008b8b97652 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/ecc5f9dec9a645a781f2e008b8b97652 2023-10-30 06:53:17,220 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/ecc5f9dec9a645a781f2e008b8b97652, entries=1, sequenceid=13, filesize=4.9 K 2023-10-30 06:53:17,221 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 08334b8a91b43e79f682fea554e7c5b6 in 447ms, sequenceid=13, compaction requested=true 2023-10-30 06:53:17,221 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:17,222 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:17,222 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:17,222 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:17,222 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,222 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:17,222 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:17,223 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,223 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:17,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:17,224 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,224 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:17,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:17,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:17,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:17,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:17,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5df1e1be[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:17,226 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:17,226 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,226 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,227 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:17,227 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:17,227 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:17,227 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,227 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:17,228 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,228 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:17,228 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:17,228 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:17,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:17,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:17,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:17,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:17,231 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:17,231 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:17,231 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:17,231 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,231 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:17,232 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,232 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,232 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:17,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:17,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:17,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:17,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:17,233 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:17,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:17,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,234 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:17,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,237 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:17,237 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,237 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:17,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:17,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:17,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 06:53:17,237 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:17,237 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:17,237 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:17,237 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,238 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:17,238 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,238 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:17,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:17,238 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:17,238 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,338 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:17,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:17,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:17,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:17,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,347 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:17,347 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:17,347 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:17,347 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:17,348 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,348 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,349 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,349 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:17,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:17,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:17,350 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:17,350 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:17,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:17,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,351 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,351 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:17,351 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:17,351 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:17,351 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:17,351 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:17,351 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:17,351 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:17,351 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:17,351 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. started... 2023-10-30 06:53:17,351 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 08334b8a91b43e79f682fea554e7c5b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:17,773 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055a1fee362d3a4757a8303aea8f1da01f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512055a1fee362d3a4757a8303aea8f1da01f 2023-10-30 06:53:18,184 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/df50c12acd1d4e7b9c3c59b1e687f33e 2023-10-30 06:53:18,198 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/df50c12acd1d4e7b9c3c59b1e687f33e as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/df50c12acd1d4e7b9c3c59b1e687f33e 2023-10-30 06:53:18,207 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/df50c12acd1d4e7b9c3c59b1e687f33e, entries=1, sequenceid=17, filesize=4.9 K 2023-10-30 06:53:18,208 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 08334b8a91b43e79f682fea554e7c5b6 in 857ms, sequenceid=17, compaction requested=true 2023-10-30 06:53:18,208 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:18,208 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:18,208 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:18,208 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:18,208 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,208 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:18,208 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:18,210 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,210 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:18,211 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,211 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:18,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:18,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:18,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:18,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@286fb033[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:18,214 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:18,214 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,215 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,216 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:18,216 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:18,216 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:18,216 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,216 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:18,217 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:18,217 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,217 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:18,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:18,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:18,218 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:18,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:18,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:18,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:18,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:18,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:18,221 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:18,222 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:18,222 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:18,222 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,222 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:18,226 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,226 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:18,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:18,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,226 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:18,227 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:18,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,229 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:18,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,234 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,234 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:18,234 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:18,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:18,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:18,234 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,235 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,235 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,235 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,235 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:18,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:18,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:18,234 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:18,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:18,235 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 06:53:18,236 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:18,236 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:18,336 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:18,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:18,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:18,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:18,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,346 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:18,346 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:18,346 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:18,346 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:18,346 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,346 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,348 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:18,348 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:18,349 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:18,349 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:18,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:18,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,350 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,350 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:18,350 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:18,351 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:18,351 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:18,351 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:18,351 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:18,351 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:18,351 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:18,351 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. started... 2023-10-30 06:53:18,351 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 08334b8a91b43e79f682fea554e7c5b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:18,781 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c6bb42e4397d4f93a0aec2b32cb7d0dc to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c6bb42e4397d4f93a0aec2b32cb7d0dc 2023-10-30 06:53:19,189 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/a9a486347ad74397bf9e571e157ee802 2023-10-30 06:53:19,202 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/a9a486347ad74397bf9e571e157ee802 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/a9a486347ad74397bf9e571e157ee802 2023-10-30 06:53:19,209 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/a9a486347ad74397bf9e571e157ee802, entries=1, sequenceid=21, filesize=4.9 K 2023-10-30 06:53:19,210 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 08334b8a91b43e79f682fea554e7c5b6 in 859ms, sequenceid=21, compaction requested=true 2023-10-30 06:53:19,210 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:19,210 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:19,210 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:19,210 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:19,210 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,210 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:19,210 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:19,212 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,212 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:19,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:19,213 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,213 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:19,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:19,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:19,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:19,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:19,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5654c773[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:19,215 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:19,215 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,216 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,216 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:19,216 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:19,216 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:19,216 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,216 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:19,217 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,217 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:19,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:19,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:19,217 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:19,217 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:19,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:19,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:19,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:19,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:19,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:19,220 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:19,221 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:19,221 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:19,221 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,221 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:19,223 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,223 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,223 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:19,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:19,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:19,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:19,224 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:19,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:19,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:19,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,225 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:19,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,232 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,232 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:19,232 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:19,232 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:19,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:19,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:19,232 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:19,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 06:53:19,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:19,232 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,232 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:19,232 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,232 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:19,232 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,233 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:19,233 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:19,333 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:19,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:19,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:19,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:19,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,349 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:19,349 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:19,349 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:19,349 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:19,350 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,350 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,351 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,351 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:19,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:19,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:19,351 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:19,351 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:19,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:19,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,352 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,352 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:19,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:19,352 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:19,352 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:19,352 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:19,352 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:19,352 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:19,352 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:19,352 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. started... 2023-10-30 06:53:19,353 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 08334b8a91b43e79f682fea554e7c5b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:19,776 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319a49256f3fb04b3dac186c9d1a046116 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512319a49256f3fb04b3dac186c9d1a046116 2023-10-30 06:53:20,121 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 06:53:20,185 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/237d43d1095f4a049b72cdd3a31de297 2023-10-30 06:53:20,193 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/237d43d1095f4a049b72cdd3a31de297 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/237d43d1095f4a049b72cdd3a31de297 2023-10-30 06:53:20,200 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/237d43d1095f4a049b72cdd3a31de297, entries=1, sequenceid=25, filesize=4.9 K 2023-10-30 06:53:20,201 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 08334b8a91b43e79f682fea554e7c5b6 in 848ms, sequenceid=25, compaction requested=true 2023-10-30 06:53:20,201 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:20,201 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:20,201 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:20,202 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:20,202 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,202 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:20,202 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:20,203 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,203 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:20,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:20,203 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,203 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:20,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:20,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40a2d5a4[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:20,205 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:20,205 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,205 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,206 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:20,206 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:20,206 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:20,206 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,206 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:20,207 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:20,207 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,207 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:20,207 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:20,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:20,210 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:20,210 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:20,210 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:20,210 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,210 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:20,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:20,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:20,212 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,213 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:20,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,214 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,214 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:20,214 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:20,214 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:20,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:20,214 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:20,214 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,214 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,214 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,214 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,214 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,214 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 06:53:20,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:20,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:20,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:20,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:20,215 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:20,215 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:20,315 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:20,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:20,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:20,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:20,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,324 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:20,324 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:20,324 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:20,324 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:20,324 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,324 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,326 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:20,326 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:20,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:20,326 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:20,326 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:20,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:20,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,327 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,327 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:20,327 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:20,328 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:20,328 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:20,328 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:20,328 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:20,328 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:20,328 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:20,328 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. started... 2023-10-30 06:53:20,328 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 08334b8a91b43e79f682fea554e7c5b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:20,754 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101e8d01de989f742e5b86f3a154a86e2b7 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101e8d01de989f742e5b86f3a154a86e2b7 2023-10-30 06:53:21,164 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/42f513ecf0084991b5361970abf36236 2023-10-30 06:53:21,178 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/42f513ecf0084991b5361970abf36236 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/42f513ecf0084991b5361970abf36236 2023-10-30 06:53:21,183 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/42f513ecf0084991b5361970abf36236, entries=1, sequenceid=29, filesize=4.9 K 2023-10-30 06:53:21,184 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 08334b8a91b43e79f682fea554e7c5b6 in 856ms, sequenceid=29, compaction requested=true 2023-10-30 06:53:21,184 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:21,184 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:21,184 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:21,184 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:21,184 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,185 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:21,185 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:21,186 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,186 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:21,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:21,186 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,186 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:21,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:21,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:21,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:21,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:21,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@120c301f[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:21,188 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:21,188 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,189 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,189 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:21,189 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:21,189 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:21,189 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,189 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:21,191 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:21,191 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,191 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:21,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:21,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:21,191 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:21,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:21,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:21,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:21,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:21,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:21,194 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:21,194 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:21,194 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:21,194 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,194 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:21,195 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,195 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:21,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:21,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,195 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:21,196 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,197 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:21,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,209 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,209 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:21,209 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:21,209 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:21,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:21,209 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:21,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:21,209 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:21,210 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:21,210 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,210 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:21,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:21,210 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:21,210 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,310 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:21,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:21,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:21,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:21,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,324 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:21,325 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:21,325 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:21,325 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:21,326 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,326 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,327 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,327 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:21,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:21,328 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:21,328 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,330 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,331 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:21,331 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:21,331 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:21,331 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:21,331 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:21,331 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:21,331 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:21,332 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:21,332 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. started... 2023-10-30 06:53:21,332 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 08334b8a91b43e79f682fea554e7c5b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:21,757 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103cdcde6ca63eb4ac79fb862db525abfac to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103cdcde6ca63eb4ac79fb862db525abfac 2023-10-30 06:53:22,167 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/6d636121d1084f2792426f77b38f6a4b 2023-10-30 06:53:22,182 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/6d636121d1084f2792426f77b38f6a4b as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/6d636121d1084f2792426f77b38f6a4b 2023-10-30 06:53:22,190 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/6d636121d1084f2792426f77b38f6a4b, entries=1, sequenceid=33, filesize=4.9 K 2023-10-30 06:53:22,192 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 08334b8a91b43e79f682fea554e7c5b6 in 860ms, sequenceid=33, compaction requested=true 2023-10-30 06:53:22,192 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:22,192 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:22,192 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:22,192 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:22,192 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,192 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:22,192 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:22,194 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,194 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:22,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:22,195 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,195 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:22,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:22,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:22,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:22,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:22,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4737f445[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:22,198 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:22,198 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,199 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:22,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:22,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:22,199 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,199 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:22,201 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,201 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:22,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:22,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:22,201 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:22,201 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:22,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:22,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:22,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:22,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:22,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:22,206 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:22,206 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:22,206 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:22,206 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,206 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:22,215 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,215 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,215 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:22,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:22,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:22,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:22,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:22,216 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:22,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:22,218 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:22,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,223 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,223 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,223 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:22,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:22,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:22,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:22,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:22,224 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:22,224 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:22,224 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 06:53:22,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:22,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:22,224 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:22,225 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,225 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:22,225 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,225 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,225 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,325 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:22,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:22,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:22,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:22,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,334 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:22,334 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:22,334 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:22,334 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:22,335 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,335 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,336 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:22,336 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:22,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:22,337 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:22,337 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:22,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,337 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:22,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,338 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,338 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:22,338 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:22,338 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:22,339 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:22,339 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:22,339 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:22,339 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:22,339 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:22,339 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. started... 2023-10-30 06:53:22,339 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 08334b8a91b43e79f682fea554e7c5b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:22,767 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c7847ad762a948968dda133745baa30d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907c7847ad762a948968dda133745baa30d 2023-10-30 06:53:23,177 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/8db71c2e10294058a91909a265be7e57 2023-10-30 06:53:23,190 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/8db71c2e10294058a91909a265be7e57 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/8db71c2e10294058a91909a265be7e57 2023-10-30 06:53:23,196 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/8db71c2e10294058a91909a265be7e57, entries=1, sequenceid=37, filesize=4.9 K 2023-10-30 06:53:23,197 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 08334b8a91b43e79f682fea554e7c5b6 in 858ms, sequenceid=37, compaction requested=true 2023-10-30 06:53:23,197 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:23,197 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:23,197 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:23,197 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:23,197 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,197 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:23,197 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:23,199 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:23,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:23,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:23,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:23,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:23,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:23,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:23,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3728dc8f[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:23,201 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:23,201 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,202 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,203 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:23,203 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:23,203 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:23,203 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,203 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:23,204 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:23,204 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:23,204 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:23,204 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:23,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:23,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:23,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:23,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:23,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:23,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:23,206 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:23,206 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:23,206 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:23,206 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,207 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:23,208 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,208 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,208 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:23,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:23,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:23,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:23,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:23,208 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:23,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:23,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,209 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:23,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:23,211 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:23,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:23,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 06:53:23,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:23,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:23,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:23,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:23,211 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,212 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,212 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,212 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:23,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:23,212 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:23,212 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:23,312 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:23,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:23,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:23,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:23,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,329 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:23,329 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:23,329 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:23,329 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:23,330 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,330 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,331 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:23,331 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:23,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:23,332 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,332 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:23,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:23,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,334 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,335 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:23,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,335 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:23,335 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:23,335 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:23,335 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:23,335 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:23,335 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:23,336 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. started... 2023-10-30 06:53:23,336 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 08334b8a91b43e79f682fea554e7c5b6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:23,766 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b4e7ecd5eeef4ca8bde147fb32734224 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120b4e7ecd5eeef4ca8bde147fb32734224 2023-10-30 06:53:23,774 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/4e2ed7d4a8c4438aa1f830ae1575e6f2 2023-10-30 06:53:23,780 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/4e2ed7d4a8c4438aa1f830ae1575e6f2 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/4e2ed7d4a8c4438aa1f830ae1575e6f2 2023-10-30 06:53:23,786 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/4e2ed7d4a8c4438aa1f830ae1575e6f2, entries=1, sequenceid=41, filesize=4.9 K 2023-10-30 06:53:23,787 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 08334b8a91b43e79f682fea554e7c5b6 in 451ms, sequenceid=41, compaction requested=true 2023-10-30 06:53:23,787 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:23,787 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:23,787 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:23,787 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:23,787 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,787 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:23,787 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:23,788 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,788 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:23,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:23,789 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:23,789 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:23,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:23,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:23,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:23,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6171303b[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:23,791 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:23,791 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,791 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,792 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:23,792 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:23,792 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:23,792 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,792 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:23,793 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:23,793 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,793 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:23,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:23,793 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:23,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:23,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:23,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:23,795 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:23,795 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:23,795 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:23,795 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,795 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:23,796 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,796 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,796 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:23,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:23,797 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:23,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,798 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,800 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,800 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,800 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,800 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:23,800 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:23,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 06:53:23,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:23,800 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,800 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,800 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,800 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:23,800 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:23,800 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:23,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:23,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 06:53:23,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:23,801 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:23,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:23,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:23,901 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:23,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:23,905 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-10-30 06:53:23,908 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 06:53:23,910 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 06:53:23,912 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649403912 2023-10-30 06:53:23,912 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:23,914 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 06:53:23,916 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-10-30 06:53:23,916 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 06:53:23,918 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x5a9840fd to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:53:23,922 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f65fa88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:53:23,922 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:24,775 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036c752b75a8e9430d97019b5c8a058712 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601036c752b75a8e9430d97019b5c8a058712 2023-10-30 06:53:24,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 06:53:24,787 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:53:24,789 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:53:24,797 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:53:24,800 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:53:24,810 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/505150b8556e4378b5475ddac4f951e6 first=Optional[r3] last=Optional[r6] 2023-10-30 06:53:24,811 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/505150b8556e4378b5475ddac4f951e6}] 2023-10-30 06:53:24,816 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/505150b8556e4378b5475ddac4f951e6 for inclusion in 08334b8a91b43e79f682fea554e7c5b6/family1 2023-10-30 06:53:24,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 06:53:24,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:53:24,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:24,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/505150b8556e4378b5475ddac4f951e6 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kf3rc5bpq8udqbrqcgko9cmspo2hteouisife4ua6lvadvq3jdlm0ivi5jkllnpa/family1/505150b8556e4378b5475ddac4f951e6 2023-10-30 06:53:24,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kf3rc5bpq8udqbrqcgko9cmspo2hteouisife4ua6lvadvq3jdlm0ivi5jkllnpa/family1/505150b8556e4378b5475ddac4f951e6 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/46428942c3b44e0ca47377a79f95e6cf_SeqId_44_ 2023-10-30 06:53:24,824 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kf3rc5bpq8udqbrqcgko9cmspo2hteouisife4ua6lvadvq3jdlm0ivi5jkllnpa/family1/505150b8556e4378b5475ddac4f951e6 into 08334b8a91b43e79f682fea554e7c5b6/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/46428942c3b44e0ca47377a79f95e6cf_SeqId_44_ - updating store file list. 2023-10-30 06:53:24,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/46428942c3b44e0ca47377a79f95e6cf_SeqId_44_ into 08334b8a91b43e79f682fea554e7c5b6/family1 2023-10-30 06:53:24,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kf3rc5bpq8udqbrqcgko9cmspo2hteouisife4ua6lvadvq3jdlm0ivi5jkllnpa/family1/505150b8556e4378b5475ddac4f951e6 into 08334b8a91b43e79f682fea554e7c5b6/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/46428942c3b44e0ca47377a79f95e6cf_SeqId_44_) 2023-10-30 06:53:24,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithWeeklyPolicy__kf3rc5bpq8udqbrqcgko9cmspo2hteouisife4ua6lvadvq3jdlm0ivi5jkllnpa/family1/505150b8556e4378b5475ddac4f951e6 2023-10-30 06:53:24,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 06:53:24,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 06:53:24,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(1912): 08334b8a91b43e79f682fea554e7c5b6/family1 is initiating minor compaction 2023-10-30 06:53:24,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5e8e570c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:24,835 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 08334b8a91b43e79f682fea554e7c5b6/family1 in testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:53:24,835 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/f480d45078b04918a7eb61e1eb84de3e, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/ecc5f9dec9a645a781f2e008b8b97652, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/df50c12acd1d4e7b9c3c59b1e687f33e, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/a9a486347ad74397bf9e571e157ee802, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/237d43d1095f4a049b72cdd3a31de297, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/42f513ecf0084991b5361970abf36236, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/6d636121d1084f2792426f77b38f6a4b, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/8db71c2e10294058a91909a265be7e57, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/4e2ed7d4a8c4438aa1f830ae1575e6f2, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/46428942c3b44e0ca47377a79f95e6cf_SeqId_44_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp, totalSize=50.0 K 2023-10-30 06:53:24,835 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting f480d45078b04918a7eb61e1eb84de3e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 06:53:24,836 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting ecc5f9dec9a645a781f2e008b8b97652, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 06:53:24,836 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting df50c12acd1d4e7b9c3c59b1e687f33e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 06:53:24,836 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting a9a486347ad74397bf9e571e157ee802, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 06:53:24,836 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 237d43d1095f4a049b72cdd3a31de297, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 06:53:24,836 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 42f513ecf0084991b5361970abf36236, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 06:53:24,836 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 6d636121d1084f2792426f77b38f6a4b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 06:53:24,836 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 8db71c2e10294058a91909a265be7e57, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 06:53:24,836 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 4e2ed7d4a8c4438aa1f830ae1575e6f2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 06:53:24,837 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 46428942c3b44e0ca47377a79f95e6cf_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 06:53:24,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 06:53:24,838 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:24,840 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c6bb42e4397d4f93a0aec2b32cb7d0dc to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c6bb42e4397d4f93a0aec2b32cb7d0dc 2023-10-30 06:53:24,841 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512319a49256f3fb04b3dac186c9d1a046116 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512319a49256f3fb04b3dac186c9d1a046116 2023-10-30 06:53:24,842 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101e8d01de989f742e5b86f3a154a86e2b7 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101e8d01de989f742e5b86f3a154a86e2b7 2023-10-30 06:53:24,843 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103cdcde6ca63eb4ac79fb862db525abfac to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103cdcde6ca63eb4ac79fb862db525abfac 2023-10-30 06:53:24,843 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-10-30 06:53:24,843 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 06:53:24,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:24,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:24,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:24,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:24,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:24,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:24,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:24,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:24,879 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): 08334b8a91b43e79f682fea554e7c5b6#family1#compaction#34 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:53:25,288 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056dbe291980ba4e41b77ffca46f7f225a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512056dbe291980ba4e41b77ffca46f7f225a 2023-10-30 06:53:25,290 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 06:53:25,315 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4cce74bf73d64641a0faa1c74cc4e70d first=Optional[r1] last=Optional[r2] 2023-10-30 06:53:25,315 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4cce74bf73d64641a0faa1c74cc4e70d}] 2023-10-30 06:53:25,319 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4cce74bf73d64641a0faa1c74cc4e70d for inclusion in 08334b8a91b43e79f682fea554e7c5b6/family1 2023-10-30 06:53:25,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-10-30 06:53:25,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:53:25,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:25,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4cce74bf73d64641a0faa1c74cc4e70d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4ldga86fp58tsvopu15aln7gjbbfg3863lt3c173i784meao51mt83jp0q2uo7jm/family1/4cce74bf73d64641a0faa1c74cc4e70d 2023-10-30 06:53:25,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4ldga86fp58tsvopu15aln7gjbbfg3863lt3c173i784meao51mt83jp0q2uo7jm/family1/4cce74bf73d64641a0faa1c74cc4e70d as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/dc039bc8231a41f5815f5cd9830c0832_SeqId_46_ 2023-10-30 06:53:25,327 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4ldga86fp58tsvopu15aln7gjbbfg3863lt3c173i784meao51mt83jp0q2uo7jm/family1/4cce74bf73d64641a0faa1c74cc4e70d into 08334b8a91b43e79f682fea554e7c5b6/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/dc039bc8231a41f5815f5cd9830c0832_SeqId_46_ - updating store file list. 2023-10-30 06:53:25,332 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/dc039bc8231a41f5815f5cd9830c0832_SeqId_46_ into 08334b8a91b43e79f682fea554e7c5b6/family1 2023-10-30 06:53:25,332 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4ldga86fp58tsvopu15aln7gjbbfg3863lt3c173i784meao51mt83jp0q2uo7jm/family1/4cce74bf73d64641a0faa1c74cc4e70d into 08334b8a91b43e79f682fea554e7c5b6/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/dc039bc8231a41f5815f5cd9830c0832_SeqId_46_) 2023-10-30 06:53:25,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithWeeklyPolicy__4ldga86fp58tsvopu15aln7gjbbfg3863lt3c173i784meao51mt83jp0q2uo7jm/family1/4cce74bf73d64641a0faa1c74cc4e70d 2023-10-30 06:53:25,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 06:53:25,336 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:25,338 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120161385c332a794356b6ffcae57d854443 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120161385c332a794356b6ffcae57d854443 2023-10-30 06:53:25,339 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512055a1fee362d3a4757a8303aea8f1da01f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512055a1fee362d3a4757a8303aea8f1da01f 2023-10-30 06:53:25,339 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-10-30 06:53:25,339 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 06:53:25,340 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:25,340 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 06:53:25,340 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:25,341 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 06:53:25,343 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4350 sec 2023-10-30 06:53:25,470 INFO [Listener at localhost/40811] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=257 (was 259), OpenFileDescriptor=625 (was 611) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 314), ProcessCount=168 (was 171), AvailableMemoryMB=2782 (was 2863) 2023-10-30 06:53:25,481 INFO [Listener at localhost/40811] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=257, OpenFileDescriptor=625, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=168, AvailableMemoryMB=2781 2023-10-30 06:53:25,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 06:53:25,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:25,486 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 06:53:25,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-10-30 06:53:25,488 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 06:53:25,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 06:53:25,490 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testScannerOnBulkLoadRefHFiles/db1da0921e563e04a85899bcf68f5d66 2023-10-30 06:53:25,490 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6a100adb532ef31b5553c0d8a0391ae5 2023-10-30 06:53:25,490 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 2023-10-30 06:53:25,490 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6a100adb532ef31b5553c0d8a0391ae5 empty. 2023-10-30 06:53:25,490 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testScannerOnBulkLoadRefHFiles/db1da0921e563e04a85899bcf68f5d66 empty. 2023-10-30 06:53:25,490 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 empty. 2023-10-30 06:53:25,491 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6a100adb532ef31b5553c0d8a0391ae5 2023-10-30 06:53:25,491 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 2023-10-30 06:53:25,491 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testScannerOnBulkLoadRefHFiles/db1da0921e563e04a85899bcf68f5d66 2023-10-30 06:53:25,491 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-10-30 06:53:25,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 06:53:25,703 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/.tmp/family1/43b03bb38c8b46a7ad52fe76447d3e70 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/43b03bb38c8b46a7ad52fe76447d3e70 2023-10-30 06:53:25,712 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 08334b8a91b43e79f682fea554e7c5b6/family1 of 08334b8a91b43e79f682fea554e7c5b6 into 43b03bb38c8b46a7ad52fe76447d3e70(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:53:25,712 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:53:25,713 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698648804835; duration=0sec 2023-10-30 06:53:25,713 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:25,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/f480d45078b04918a7eb61e1eb84de3e, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/ecc5f9dec9a645a781f2e008b8b97652, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/df50c12acd1d4e7b9c3c59b1e687f33e, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/a9a486347ad74397bf9e571e157ee802, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/237d43d1095f4a049b72cdd3a31de297, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/42f513ecf0084991b5361970abf36236, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/6d636121d1084f2792426f77b38f6a4b, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/8db71c2e10294058a91909a265be7e57, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/4e2ed7d4a8c4438aa1f830ae1575e6f2, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/46428942c3b44e0ca47377a79f95e6cf_SeqId_44_] to archive 2023-10-30 06:53:25,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:25,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/f480d45078b04918a7eb61e1eb84de3e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/f480d45078b04918a7eb61e1eb84de3e 2023-10-30 06:53:25,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/ecc5f9dec9a645a781f2e008b8b97652 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/ecc5f9dec9a645a781f2e008b8b97652 2023-10-30 06:53:25,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/df50c12acd1d4e7b9c3c59b1e687f33e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/df50c12acd1d4e7b9c3c59b1e687f33e 2023-10-30 06:53:25,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/a9a486347ad74397bf9e571e157ee802 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/a9a486347ad74397bf9e571e157ee802 2023-10-30 06:53:25,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/237d43d1095f4a049b72cdd3a31de297 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/237d43d1095f4a049b72cdd3a31de297 2023-10-30 06:53:25,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/42f513ecf0084991b5361970abf36236 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/42f513ecf0084991b5361970abf36236 2023-10-30 06:53:25,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/6d636121d1084f2792426f77b38f6a4b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/6d636121d1084f2792426f77b38f6a4b 2023-10-30 06:53:25,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/8db71c2e10294058a91909a265be7e57 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/8db71c2e10294058a91909a265be7e57 2023-10-30 06:53:25,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/4e2ed7d4a8c4438aa1f830ae1575e6f2 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/4e2ed7d4a8c4438aa1f830ae1575e6f2 2023-10-30 06:53:25,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/46428942c3b44e0ca47377a79f95e6cf_SeqId_44_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/family1/46428942c3b44e0ca47377a79f95e6cf_SeqId_44_ 2023-10-30 06:53:25,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 06:53:25,902 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-10-30 06:53:25,904 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => db1da0921e563e04a85899bcf68f5d66, NAME => 'testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:53:25,906 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6a100adb532ef31b5553c0d8a0391ae5, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:53:25,906 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:53:26,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 06:53:26,322 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:26,323 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing db1da0921e563e04a85899bcf68f5d66, disabling compactions & flushes 2023-10-30 06:53:26,323 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:53:26,323 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:53:26,324 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. after waiting 0 ms 2023-10-30 06:53:26,324 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:53:26,324 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:26,324 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:53:26,324 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4, disabling compactions & flushes 2023-10-30 06:53:26,324 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for db1da0921e563e04a85899bcf68f5d66: 2023-10-30 06:53:26,324 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:53:26,324 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:53:26,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. after waiting 0 ms 2023-10-30 06:53:26,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:53:26,325 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:53:26,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4: 2023-10-30 06:53:26,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:26,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 6a100adb532ef31b5553c0d8a0391ae5, disabling compactions & flushes 2023-10-30 06:53:26,325 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:53:26,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:53:26,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. after waiting 0 ms 2023-10-30 06:53:26,326 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:53:26,326 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:53:26,326 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 6a100adb532ef31b5553c0d8a0391ae5: 2023-10-30 06:53:26,330 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 06:53:26,332 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698648806331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648806331"}]},"ts":"1698648806331"} 2023-10-30 06:53:26,332 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698648806331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648806331"}]},"ts":"1698648806331"} 2023-10-30 06:53:26,332 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698648806331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648806331"}]},"ts":"1698648806331"} 2023-10-30 06:53:26,335 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 06:53:26,337 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 06:53:26,337 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648806337"}]},"ts":"1698648806337"} 2023-10-30 06:53:26,338 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-10-30 06:53:26,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=db1da0921e563e04a85899bcf68f5d66, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6a100adb532ef31b5553c0d8a0391ae5, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0ff0bf9cf9b6b7c50c2bdb9357b7e7a4, ASSIGN}] 2023-10-30 06:53:26,343 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0ff0bf9cf9b6b7c50c2bdb9357b7e7a4, ASSIGN 2023-10-30 06:53:26,343 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6a100adb532ef31b5553c0d8a0391ae5, ASSIGN 2023-10-30 06:53:26,343 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=db1da0921e563e04a85899bcf68f5d66, ASSIGN 2023-10-30 06:53:26,344 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6a100adb532ef31b5553c0d8a0391ae5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:53:26,344 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0ff0bf9cf9b6b7c50c2bdb9357b7e7a4, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:53:26,344 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=db1da0921e563e04a85899bcf68f5d66, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:53:26,496 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6a100adb532ef31b5553c0d8a0391ae5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:26,496 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=0ff0bf9cf9b6b7c50c2bdb9357b7e7a4, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:26,496 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=db1da0921e563e04a85899bcf68f5d66, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:26,497 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698648806496"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648806496"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648806496"}]},"ts":"1698648806496"} 2023-10-30 06:53:26,497 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698648806496"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648806496"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648806496"}]},"ts":"1698648806496"} 2023-10-30 06:53:26,497 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698648806496"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648806496"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648806496"}]},"ts":"1698648806496"} 2023-10-30 06:53:26,499 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 6a100adb532ef31b5553c0d8a0391ae5, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:53:26,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure db1da0921e563e04a85899bcf68f5d66, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:53:26,502 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:53:26,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 06:53:26,652 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:26,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:53:26,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 06:53:26,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 2023-10-30 06:53:26,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:26,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 2023-10-30 06:53:26,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 2023-10-30 06:53:26,664 INFO [StoreOpener-0ff0bf9cf9b6b7c50c2bdb9357b7e7a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 2023-10-30 06:53:26,666 DEBUG [StoreOpener-0ff0bf9cf9b6b7c50c2bdb9357b7e7a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1 2023-10-30 06:53:26,666 DEBUG [StoreOpener-0ff0bf9cf9b6b7c50c2bdb9357b7e7a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1 2023-10-30 06:53:26,667 INFO [StoreOpener-0ff0bf9cf9b6b7c50c2bdb9357b7e7a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 columnFamilyName family1 2023-10-30 06:53:26,670 INFO [StoreOpener-0ff0bf9cf9b6b7c50c2bdb9357b7e7a4-1] regionserver.HStore(310): Store=0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:53:26,670 INFO [StoreOpener-0ff0bf9cf9b6b7c50c2bdb9357b7e7a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 2023-10-30 06:53:26,672 DEBUG [StoreOpener-0ff0bf9cf9b6b7c50c2bdb9357b7e7a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family2 2023-10-30 06:53:26,673 DEBUG [StoreOpener-0ff0bf9cf9b6b7c50c2bdb9357b7e7a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family2 2023-10-30 06:53:26,673 INFO [StoreOpener-0ff0bf9cf9b6b7c50c2bdb9357b7e7a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 columnFamilyName family2 2023-10-30 06:53:26,675 INFO [StoreOpener-0ff0bf9cf9b6b7c50c2bdb9357b7e7a4-1] regionserver.HStore(310): Store=0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:53:26,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 2023-10-30 06:53:26,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 2023-10-30 06:53:26,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:53:26,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 2023-10-30 06:53:26,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:53:26,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74961005, jitterRate=0.11700601875782013}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:53:26,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4: 2023-10-30 06:53:26,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4., pid=33, masterSystemTime=1698648806652 2023-10-30 06:53:26,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:53:26,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:53:26,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:53:26,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6a100adb532ef31b5553c0d8a0391ae5, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 06:53:26,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 6a100adb532ef31b5553c0d8a0391ae5 2023-10-30 06:53:26,687 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=0ff0bf9cf9b6b7c50c2bdb9357b7e7a4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:26,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:26,687 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698648806687"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648806687"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648806687"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648806687"}]},"ts":"1698648806687"} 2023-10-30 06:53:26,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6a100adb532ef31b5553c0d8a0391ae5 2023-10-30 06:53:26,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6a100adb532ef31b5553c0d8a0391ae5 2023-10-30 06:53:26,689 INFO [StoreOpener-6a100adb532ef31b5553c0d8a0391ae5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6a100adb532ef31b5553c0d8a0391ae5 2023-10-30 06:53:26,691 DEBUG [StoreOpener-6a100adb532ef31b5553c0d8a0391ae5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/6a100adb532ef31b5553c0d8a0391ae5/family1 2023-10-30 06:53:26,691 DEBUG [StoreOpener-6a100adb532ef31b5553c0d8a0391ae5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/6a100adb532ef31b5553c0d8a0391ae5/family1 2023-10-30 06:53:26,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=30 2023-10-30 06:53:26,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4, server=jenkins-hbase20.apache.org,40611,1698648765457 in 188 msec 2023-10-30 06:53:26,691 INFO [StoreOpener-6a100adb532ef31b5553c0d8a0391ae5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a100adb532ef31b5553c0d8a0391ae5 columnFamilyName family1 2023-10-30 06:53:26,693 INFO [StoreOpener-6a100adb532ef31b5553c0d8a0391ae5-1] regionserver.HStore(310): Store=6a100adb532ef31b5553c0d8a0391ae5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:53:26,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0ff0bf9cf9b6b7c50c2bdb9357b7e7a4, ASSIGN in 350 msec 2023-10-30 06:53:26,693 INFO [StoreOpener-6a100adb532ef31b5553c0d8a0391ae5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6a100adb532ef31b5553c0d8a0391ae5 2023-10-30 06:53:26,696 DEBUG [StoreOpener-6a100adb532ef31b5553c0d8a0391ae5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/6a100adb532ef31b5553c0d8a0391ae5/family2 2023-10-30 06:53:26,696 DEBUG [StoreOpener-6a100adb532ef31b5553c0d8a0391ae5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/6a100adb532ef31b5553c0d8a0391ae5/family2 2023-10-30 06:53:26,697 INFO [StoreOpener-6a100adb532ef31b5553c0d8a0391ae5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a100adb532ef31b5553c0d8a0391ae5 columnFamilyName family2 2023-10-30 06:53:26,698 INFO [StoreOpener-6a100adb532ef31b5553c0d8a0391ae5-1] regionserver.HStore(310): Store=6a100adb532ef31b5553c0d8a0391ae5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:53:26,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/6a100adb532ef31b5553c0d8a0391ae5 2023-10-30 06:53:26,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/6a100adb532ef31b5553c0d8a0391ae5 2023-10-30 06:53:26,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:53:26,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6a100adb532ef31b5553c0d8a0391ae5 2023-10-30 06:53:26,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/6a100adb532ef31b5553c0d8a0391ae5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:53:26,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6a100adb532ef31b5553c0d8a0391ae5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61041341, jitterRate=-0.09041313827037811}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:53:26,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6a100adb532ef31b5553c0d8a0391ae5: 2023-10-30 06:53:26,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5., pid=31, masterSystemTime=1698648806652 2023-10-30 06:53:26,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:53:26,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:53:26,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:53:26,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db1da0921e563e04a85899bcf68f5d66, NAME => 'testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 06:53:26,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles db1da0921e563e04a85899bcf68f5d66 2023-10-30 06:53:26,706 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6a100adb532ef31b5553c0d8a0391ae5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:26,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:26,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for db1da0921e563e04a85899bcf68f5d66 2023-10-30 06:53:26,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for db1da0921e563e04a85899bcf68f5d66 2023-10-30 06:53:26,706 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698648806706"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648806706"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648806706"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648806706"}]},"ts":"1698648806706"} 2023-10-30 06:53:26,708 INFO [StoreOpener-db1da0921e563e04a85899bcf68f5d66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region db1da0921e563e04a85899bcf68f5d66 2023-10-30 06:53:26,709 DEBUG [StoreOpener-db1da0921e563e04a85899bcf68f5d66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/db1da0921e563e04a85899bcf68f5d66/family1 2023-10-30 06:53:26,709 DEBUG [StoreOpener-db1da0921e563e04a85899bcf68f5d66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/db1da0921e563e04a85899bcf68f5d66/family1 2023-10-30 06:53:26,710 INFO [StoreOpener-db1da0921e563e04a85899bcf68f5d66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db1da0921e563e04a85899bcf68f5d66 columnFamilyName family1 2023-10-30 06:53:26,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-30 06:53:26,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 6a100adb532ef31b5553c0d8a0391ae5, server=jenkins-hbase20.apache.org,40611,1698648765457 in 209 msec 2023-10-30 06:53:26,711 INFO [StoreOpener-db1da0921e563e04a85899bcf68f5d66-1] regionserver.HStore(310): Store=db1da0921e563e04a85899bcf68f5d66/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:53:26,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6a100adb532ef31b5553c0d8a0391ae5, ASSIGN in 369 msec 2023-10-30 06:53:26,712 INFO [StoreOpener-db1da0921e563e04a85899bcf68f5d66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region db1da0921e563e04a85899bcf68f5d66 2023-10-30 06:53:26,713 DEBUG [StoreOpener-db1da0921e563e04a85899bcf68f5d66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/db1da0921e563e04a85899bcf68f5d66/family2 2023-10-30 06:53:26,713 DEBUG [StoreOpener-db1da0921e563e04a85899bcf68f5d66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/db1da0921e563e04a85899bcf68f5d66/family2 2023-10-30 06:53:26,713 INFO [StoreOpener-db1da0921e563e04a85899bcf68f5d66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db1da0921e563e04a85899bcf68f5d66 columnFamilyName family2 2023-10-30 06:53:26,714 INFO [StoreOpener-db1da0921e563e04a85899bcf68f5d66-1] regionserver.HStore(310): Store=db1da0921e563e04a85899bcf68f5d66/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:53:26,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/db1da0921e563e04a85899bcf68f5d66 2023-10-30 06:53:26,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/db1da0921e563e04a85899bcf68f5d66 2023-10-30 06:53:26,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:53:26,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for db1da0921e563e04a85899bcf68f5d66 2023-10-30 06:53:26,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/db1da0921e563e04a85899bcf68f5d66/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:53:26,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened db1da0921e563e04a85899bcf68f5d66; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62581261, jitterRate=-0.06746654212474823}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:53:26,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for db1da0921e563e04a85899bcf68f5d66: 2023-10-30 06:53:26,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66., pid=32, masterSystemTime=1698648806652 2023-10-30 06:53:26,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:53:26,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:53:26,724 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=db1da0921e563e04a85899bcf68f5d66, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:26,725 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698648806724"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648806724"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648806724"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648806724"}]},"ts":"1698648806724"} 2023-10-30 06:53:26,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=28 2023-10-30 06:53:26,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure db1da0921e563e04a85899bcf68f5d66, server=jenkins-hbase20.apache.org,40611,1698648765457 in 226 msec 2023-10-30 06:53:26,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-30 06:53:26,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=db1da0921e563e04a85899bcf68f5d66, ASSIGN in 388 msec 2023-10-30 06:53:26,732 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 06:53:26,732 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648806732"}]},"ts":"1698648806732"} 2023-10-30 06:53:26,734 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-10-30 06:53:26,736 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 06:53:26,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2530 sec 2023-10-30 06:53:27,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 06:53:27,599 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-10-30 06:53:27,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:27,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:27,617 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-10-30 06:53:27,617 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:27,617 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-10-30 06:53:27,617 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-10-30 06:53:27,618 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:27,618 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:27,619 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:27,619 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:27,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:27,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:27,620 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:27,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:27,620 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:27,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:27,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:27,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:27,622 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:27,622 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:27,622 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-10-30 06:53:27,622 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:27,622 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-10-30 06:53:27,623 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:53:27,623 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. started... 2023-10-30 06:53:27,623 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:53:27,624 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. started... 2023-10-30 06:53:27,623 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:53:27,625 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 2/2 column families, dataSize=48 B heapSize=632 B 2023-10-30 06:53:27,625 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:27,624 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:53:27,625 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. started... 2023-10-30 06:53:27,624 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db1da0921e563e04a85899bcf68f5d66: 2023-10-30 06:53:27,626 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:53:27,626 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6a100adb532ef31b5553c0d8a0391ae5: 2023-10-30 06:53:27,626 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:53:27,626 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:53:27,627 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:53:28,047 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030db0a38d1c7c64684a179f99485997fc5 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231030db0a38d1c7c64684a179f99485997fc5 2023-10-30 06:53:28,455 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/.tmp/family1/7b72da39428c4dcab95a67e4a1dee7a0 2023-10-30 06:53:28,468 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/.tmp/family1/7b72da39428c4dcab95a67e4a1dee7a0 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/7b72da39428c4dcab95a67e4a1dee7a0 2023-10-30 06:53:28,474 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/7b72da39428c4dcab95a67e4a1dee7a0, entries=1, sequenceid=5, filesize=4.9 K 2023-10-30 06:53:28,475 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 in 850ms, sequenceid=5, compaction requested=false 2023-10-30 06:53:28,475 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-10-30 06:53:28,476 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4: 2023-10-30 06:53:28,476 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:53:28,476 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:53:28,476 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:53:28,476 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,476 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-10-30 06:53:28,476 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-10-30 06:53:28,477 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,477 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:28,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:28,478 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,478 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:28,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:28,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:28,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:28,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-10-30 06:53:28,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@128e68c2[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:28,480 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-10-30 06:53:28,480 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,480 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,481 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-10-30 06:53:28,481 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-10-30 06:53:28,481 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,481 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:28,481 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:28,482 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,482 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-10-30 06:53:28,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:28,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:28,482 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:28,482 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-10-30 06:53:28,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:28,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:28,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:28,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:28,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-10-30 06:53:28,484 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-10-30 06:53:28,485 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:28,485 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:28,485 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,485 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:28,486 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,486 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:28,486 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,486 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:28,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,487 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,490 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,490 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:28,490 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,490 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:28,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-10-30 06:53:28,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:28,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:28,490 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-10-30 06:53:28,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:28,490 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:28,490 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:28,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:28,490 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,491 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,491 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:28,491 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,491 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:28,591 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:28,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:28,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:28,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:28,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,605 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-10-30 06:53:28,605 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:28,605 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-10-30 06:53:28,605 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-10-30 06:53:28,605 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,605 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,607 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,607 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:28,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:28,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:28,608 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:28,608 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:28,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,609 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,609 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,610 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-10-30 06:53:28,610 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:28,610 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-10-30 06:53:28,610 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:28,610 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-10-30 06:53:28,610 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:53:28,610 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. started... 2023-10-30 06:53:28,610 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:53:28,611 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. started... 2023-10-30 06:53:28,610 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:53:28,611 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 2/2 column families, dataSize=90 B heapSize=752 B 2023-10-30 06:53:28,611 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:28,611 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db1da0921e563e04a85899bcf68f5d66: 2023-10-30 06:53:28,611 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:53:28,611 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. started... 2023-10-30 06:53:28,611 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:53:28,611 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6a100adb532ef31b5553c0d8a0391ae5: 2023-10-30 06:53:28,611 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:53:28,611 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:53:28,612 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:53:29,039 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310305e1720cda49c48099eabb2e0fb0330cd to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202310305e1720cda49c48099eabb2e0fb0330cd 2023-10-30 06:53:29,446 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/.tmp/family1/db36ce694a874df1a115ad62bb9ac20b 2023-10-30 06:53:29,461 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/.tmp/family1/db36ce694a874df1a115ad62bb9ac20b as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/db36ce694a874df1a115ad62bb9ac20b 2023-10-30 06:53:29,468 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/db36ce694a874df1a115ad62bb9ac20b, entries=2, sequenceid=9, filesize=5.0 K 2023-10-30 06:53:29,469 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 in 858ms, sequenceid=9, compaction requested=false 2023-10-30 06:53:29,470 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4: 2023-10-30 06:53:29,470 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:53:29,470 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:53:29,470 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:53:29,470 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,470 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-10-30 06:53:29,470 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-10-30 06:53:29,472 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,472 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:29,473 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,473 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:29,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-10-30 06:53:29,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a63330a[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:29,476 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-10-30 06:53:29,476 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,477 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,477 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-10-30 06:53:29,477 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-10-30 06:53:29,477 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:29,477 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,477 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:29,478 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-10-30 06:53:29,478 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,478 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:29,478 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-10-30 06:53:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:29,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-10-30 06:53:29,482 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-10-30 06:53:29,482 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:29,482 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:29,482 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,483 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:29,492 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,492 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:29,492 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:29,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:29,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:29,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:29,493 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,494 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:29,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,500 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,501 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:29,501 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-10-30 06:53:29,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-10-30 06:53:29,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:29,501 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,501 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:29,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:29,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:29,501 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:29,502 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:29,501 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:29,501 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:29,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:29,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:29,502 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,502 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,503 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,602 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:29,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:29,617 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-10-30 06:53:29,618 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-30 06:53:29,619 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-30 06:53:29,620 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649409620 2023-10-30 06:53:29,620 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:29,621 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 06:53:29,621 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-10-30 06:53:29,621 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-30 06:53:29,623 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x1fd031d9 to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:53:29,627 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f812911, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:53:29,628 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-10-30 06:53:30,475 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030da19babdd2e54d8fb0570886015d5658 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231030da19babdd2e54d8fb0570886015d5658 2023-10-30 06:53:30,476 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-30 06:53:30,490 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:53:30,491 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:53:30,498 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:53:30,500 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:53:30,524 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:53:30,524 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a9840fd to 127.0.0.1:50449 2023-10-30 06:53:30,524 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:53:30,525 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:53:30,525 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e7573fe to 127.0.0.1:50449 2023-10-30 06:53:30,528 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:53:30,528 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:53:30,528 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f18a674 to 127.0.0.1:50449 2023-10-30 06:53:30,528 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:53:30,528 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:53:30,528 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5308628e to 127.0.0.1:50449 2023-10-30 06:53:30,528 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:53:30,531 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030/family1/987b18193407483a920807e3021813d1 first=Optional[k0] last=Optional[k1] 2023-10-30 06:53:30,532 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030/family1/987b18193407483a920807e3021813d1}] 2023-10-30 06:53:30,537 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030/family1/987b18193407483a920807e3021813d1 for inclusion in 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1 2023-10-30 06:53:30,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-10-30 06:53:30,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 06:53:30,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4: 2023-10-30 06:53:30,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030/family1/987b18193407483a920807e3021813d1 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testScannerOnBulkLoadRefHFiles__kb3r699s7n82c0qqthk1416pnaobvl5pfmal6bmjkboaqvqtr630588hhge90k29/family1/987b18193407483a920807e3021813d1 2023-10-30 06:53:30,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testScannerOnBulkLoadRefHFiles__kb3r699s7n82c0qqthk1416pnaobvl5pfmal6bmjkboaqvqtr630588hhge90k29/family1/987b18193407483a920807e3021813d1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/dc64f88e946d45acb32c406a10dafc43_SeqId_12_ 2023-10-30 06:53:30,544 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testScannerOnBulkLoadRefHFiles__kb3r699s7n82c0qqthk1416pnaobvl5pfmal6bmjkboaqvqtr630588hhge90k29/family1/987b18193407483a920807e3021813d1 into 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/dc64f88e946d45acb32c406a10dafc43_SeqId_12_ - updating store file list. 2023-10-30 06:53:30,547 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/dc64f88e946d45acb32c406a10dafc43_SeqId_12_ into 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1 2023-10-30 06:53:30,548 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testScannerOnBulkLoadRefHFiles__kb3r699s7n82c0qqthk1416pnaobvl5pfmal6bmjkboaqvqtr630588hhge90k29/family1/987b18193407483a920807e3021813d1 into 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/dc64f88e946d45acb32c406a10dafc43_SeqId_12_) 2023-10-30 06:53:30,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testScannerOnBulkLoadRefHFiles__kb3r699s7n82c0qqthk1416pnaobvl5pfmal6bmjkboaqvqtr630588hhge90k29/family1/987b18193407483a920807e3021813d1 2023-10-30 06:53:30,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 06:53:30,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 06:53:30,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(1912): 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1 is initiating minor compaction (all files) 2023-10-30 06:53:30,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3daf5ab5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:30,549 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1 in testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:53:30,550 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/7b72da39428c4dcab95a67e4a1dee7a0, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/db36ce694a874df1a115ad62bb9ac20b, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/dc64f88e946d45acb32c406a10dafc43_SeqId_12_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/.tmp, totalSize=15.1 K 2023-10-30 06:53:30,550 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 7b72da39428c4dcab95a67e4a1dee7a0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648807599 2023-10-30 06:53:30,550 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting db36ce694a874df1a115ad62bb9ac20b, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648807599 2023-10-30 06:53:30,551 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting dc64f88e946d45acb32c406a10dafc43_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648807599 2023-10-30 06:53:30,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-30 06:53:30,552 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:30,554 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202310305e1720cda49c48099eabb2e0fb0330cd to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202310305e1720cda49c48099eabb2e0fb0330cd 2023-10-30 06:53:30,555 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231030db0a38d1c7c64684a179f99485997fc5 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231030db0a38d1c7c64684a179f99485997fc5 2023-10-30 06:53:30,555 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-10-30 06:53:30,555 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 06:53:30,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-10-30 06:53:30,555 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-30 06:53:30,555 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:30,556 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-30 06:53:30,558 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 939 msec 2023-10-30 06:53:30,561 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4#family1#compaction#37 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:53:30,597 INFO [Listener at localhost/40811] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=257 (was 257), OpenFileDescriptor=604 (was 625), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=244 (was 266), ProcessCount=168 (was 168), AvailableMemoryMB=2721 (was 2781) 2023-10-30 06:53:30,609 INFO [Listener at localhost/40811] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=257, OpenFileDescriptor=604, MaxFileDescriptor=60000, SystemLoadAverage=244, ProcessCount=168, AvailableMemoryMB=2721 2023-10-30 06:53:30,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 06:53:30,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:30,614 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 06:53:30,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-10-30 06:53:30,615 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 06:53:30,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 06:53:30,616 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e 2023-10-30 06:53:30,616 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e empty. 2023-10-30 06:53:30,617 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e 2023-10-30 06:53:30,617 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-10-30 06:53:30,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 06:53:30,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 06:53:31,027 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-30 06:53:31,030 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 43679c57208aa4c0c4684e9c52821d7e, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:53:31,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 06:53:31,440 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:31,440 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 43679c57208aa4c0c4684e9c52821d7e, disabling compactions & flushes 2023-10-30 06:53:31,440 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:31,440 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:31,441 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. after waiting 0 ms 2023-10-30 06:53:31,441 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:31,441 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:31,441 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:31,447 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 06:53:31,449 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698648811449"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648811449"}]},"ts":"1698648811449"} 2023-10-30 06:53:31,451 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 06:53:31,452 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 06:53:31,452 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648811452"}]},"ts":"1698648811452"} 2023-10-30 06:53:31,454 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-10-30 06:53:31,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=43679c57208aa4c0c4684e9c52821d7e, ASSIGN}] 2023-10-30 06:53:31,460 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=43679c57208aa4c0c4684e9c52821d7e, ASSIGN 2023-10-30 06:53:31,461 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=43679c57208aa4c0c4684e9c52821d7e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:53:31,612 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=43679c57208aa4c0c4684e9c52821d7e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:31,612 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698648811612"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648811612"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648811612"}]},"ts":"1698648811612"} 2023-10-30 06:53:31,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 43679c57208aa4c0c4684e9c52821d7e, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:53:31,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 06:53:31,768 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:31,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:31,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 43679c57208aa4c0c4684e9c52821d7e, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:53:31,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 43679c57208aa4c0c4684e9c52821d7e 2023-10-30 06:53:31,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:31,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 43679c57208aa4c0c4684e9c52821d7e 2023-10-30 06:53:31,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 43679c57208aa4c0c4684e9c52821d7e 2023-10-30 06:53:31,774 INFO [StoreOpener-43679c57208aa4c0c4684e9c52821d7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 43679c57208aa4c0c4684e9c52821d7e 2023-10-30 06:53:31,776 DEBUG [StoreOpener-43679c57208aa4c0c4684e9c52821d7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1 2023-10-30 06:53:31,776 DEBUG [StoreOpener-43679c57208aa4c0c4684e9c52821d7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1 2023-10-30 06:53:31,776 INFO [StoreOpener-43679c57208aa4c0c4684e9c52821d7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43679c57208aa4c0c4684e9c52821d7e columnFamilyName family1 2023-10-30 06:53:31,779 INFO [StoreOpener-43679c57208aa4c0c4684e9c52821d7e-1] regionserver.HStore(310): Store=43679c57208aa4c0c4684e9c52821d7e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:53:31,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e 2023-10-30 06:53:31,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e 2023-10-30 06:53:31,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 43679c57208aa4c0c4684e9c52821d7e 2023-10-30 06:53:31,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:53:31,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 43679c57208aa4c0c4684e9c52821d7e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60465925, jitterRate=-0.09898750483989716}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:53:31,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:31,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e., pid=37, masterSystemTime=1698648811768 2023-10-30 06:53:31,791 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/.tmp/family1/a21e392293bf44ec95e05e4ee808e073 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/a21e392293bf44ec95e05e4ee808e073 2023-10-30 06:53:31,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:31,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:31,792 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=43679c57208aa4c0c4684e9c52821d7e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:31,792 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698648811792"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648811792"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648811792"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648811792"}]},"ts":"1698648811792"} 2023-10-30 06:53:31,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-30 06:53:31,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 43679c57208aa4c0c4684e9c52821d7e, server=jenkins-hbase20.apache.org,40611,1698648765457 in 179 msec 2023-10-30 06:53:31,797 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1 of 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 into a21e392293bf44ec95e05e4ee808e073(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:53:31,797 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4: 2023-10-30 06:53:31,797 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1698648810549; duration=1sec 2023-10-30 06:53:31,797 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:31,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-10-30 06:53:31,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=43679c57208aa4c0c4684e9c52821d7e, ASSIGN in 339 msec 2023-10-30 06:53:31,798 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 06:53:31,798 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648811798"}]},"ts":"1698648811798"} 2023-10-30 06:53:31,800 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-10-30 06:53:31,801 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 06:53:31,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1900 sec 2023-10-30 06:53:31,840 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/7b72da39428c4dcab95a67e4a1dee7a0, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/db36ce694a874df1a115ad62bb9ac20b, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/dc64f88e946d45acb32c406a10dafc43_SeqId_12_] to archive 2023-10-30 06:53:31,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:31,845 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/7b72da39428c4dcab95a67e4a1dee7a0 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/7b72da39428c4dcab95a67e4a1dee7a0 2023-10-30 06:53:31,848 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/db36ce694a874df1a115ad62bb9ac20b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/db36ce694a874df1a115ad62bb9ac20b 2023-10-30 06:53:31,850 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/dc64f88e946d45acb32c406a10dafc43_SeqId_12_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/family1/dc64f88e946d45acb32c406a10dafc43_SeqId_12_ 2023-10-30 06:53:32,193 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 06:53:32,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 06:53:32,729 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-10-30 06:53:32,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:32,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:32,763 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:32,763 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:32,763 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:32,763 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:32,764 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:32,764 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:32,765 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:32,765 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:32,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:32,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:32,765 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:32,765 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:32,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:32,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:32,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:32,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:32,766 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:32,766 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:32,766 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:32,766 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:32,766 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:32,766 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:32,766 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:32,766 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:32,766 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. started... 2023-10-30 06:53:32,767 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 43679c57208aa4c0c4684e9c52821d7e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 06:53:33,197 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130096bb23cebbb4ce4818bf11d049a5729 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130096bb23cebbb4ce4818bf11d049a5729 2023-10-30 06:53:33,603 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/8a16f80850174d6f912c886c98449a96 2023-10-30 06:53:33,614 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/8a16f80850174d6f912c886c98449a96 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/8a16f80850174d6f912c886c98449a96 2023-10-30 06:53:33,621 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/8a16f80850174d6f912c886c98449a96, entries=1000, sequenceid=5, filesize=165.1 K 2023-10-30 06:53:33,622 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 43679c57208aa4c0c4684e9c52821d7e in 855ms, sequenceid=5, compaction requested=false 2023-10-30 06:53:33,622 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:33,623 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:33,623 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:33,623 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:33,623 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:33,623 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,623 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:33,623 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:33,625 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,625 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:33,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:33,625 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,626 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:33,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:33,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:33,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:33,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:33,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b5e466d[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:33,627 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:33,627 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,628 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,628 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:33,628 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:33,628 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:33,628 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,628 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:33,629 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,629 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:33,629 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:33,629 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:33,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:33,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:33,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:33,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:33,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:33,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:33,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:33,631 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:33,631 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:33,631 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:33,631 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,631 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:33,632 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,632 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:33,632 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:33,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:33,633 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,634 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,635 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,635 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,635 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:33,635 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:33,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:33,635 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:33,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:33,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:33,635 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,635 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:33,635 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,635 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,635 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:33,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:33,636 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:33,636 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:33,736 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:33,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:33,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:33,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:33,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,752 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:33,752 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:33,752 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:33,752 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:33,753 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,753 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,754 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:33,755 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:33,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:33,755 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:33,755 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:33,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:33,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,757 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,757 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:33,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:33,757 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:33,758 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:33,758 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:33,758 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:33,758 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:33,758 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:33,758 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. started... 2023-10-30 06:53:33,758 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 43679c57208aa4c0c4684e9c52821d7e 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 06:53:34,178 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128da7456a92da24b86a21348ecd21adf67 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128da7456a92da24b86a21348ecd21adf67 2023-10-30 06:53:34,585 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/3bee7e7dd97c4ab48f41682cb7f86bad 2023-10-30 06:53:34,590 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/3bee7e7dd97c4ab48f41682cb7f86bad as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/3bee7e7dd97c4ab48f41682cb7f86bad 2023-10-30 06:53:34,594 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/3bee7e7dd97c4ab48f41682cb7f86bad, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 06:53:34,595 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 43679c57208aa4c0c4684e9c52821d7e in 837ms, sequenceid=9, compaction requested=false 2023-10-30 06:53:34,595 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:34,595 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:34,595 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:34,595 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:34,595 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,595 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:34,595 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:34,598 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,598 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:34,598 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,598 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:34,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:34,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73c65dd5[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:34,600 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:34,600 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,601 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,601 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:34,601 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:34,601 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:34,601 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,601 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:34,602 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,602 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:34,602 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:34,602 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:34,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:34,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:34,605 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:34,605 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:34,605 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:34,605 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,605 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:34,606 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,606 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:34,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:34,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,606 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:34,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:34,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:34,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:34,607 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:34,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,609 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:34,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,610 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,610 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,610 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:34,610 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:34,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:34,610 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:34,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:34,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:34,610 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,611 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,611 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,611 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,610 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:34,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:34,611 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:34,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:34,611 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:34,711 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:34,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:34,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:34,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:34,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,728 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:34,728 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:34,728 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:34,728 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:34,729 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,729 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,730 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:34,730 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:34,731 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:34,731 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:34,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,732 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,732 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:34,732 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:34,732 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:34,732 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:34,733 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:34,733 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:34,733 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:34,733 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:34,733 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. started... 2023-10-30 06:53:34,733 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 43679c57208aa4c0c4684e9c52821d7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:35,156 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013b08d9bcbdcb41509be1144a567c4505 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512013b08d9bcbdcb41509be1144a567c4505 2023-10-30 06:53:35,565 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/c3b948d5c18d45f086e4d1feb3d4714c 2023-10-30 06:53:35,580 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/c3b948d5c18d45f086e4d1feb3d4714c as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/c3b948d5c18d45f086e4d1feb3d4714c 2023-10-30 06:53:35,587 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/c3b948d5c18d45f086e4d1feb3d4714c, entries=1, sequenceid=13, filesize=4.9 K 2023-10-30 06:53:35,588 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43679c57208aa4c0c4684e9c52821d7e in 855ms, sequenceid=13, compaction requested=true 2023-10-30 06:53:35,588 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:35,588 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:35,588 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:35,588 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:35,589 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,589 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:35,589 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:35,590 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,590 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:35,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:35,591 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,591 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:35,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:35,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12efe317[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:35,592 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:35,592 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,593 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,593 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:35,593 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:35,593 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:35,593 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,593 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:35,594 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,594 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:35,594 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:35,594 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:35,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:35,596 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:35,596 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:35,596 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:35,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:35,596 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,596 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:35,597 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,597 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:35,597 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:35,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:35,597 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,598 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:35,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:35,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:35,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:35,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:35,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,600 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:35,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:35,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:35,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:35,600 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:35,600 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:35,700 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:35,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:35,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:35,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:35,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,713 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:35,713 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:35,713 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:35,713 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:35,713 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,713 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,714 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,714 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:35,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:35,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:35,715 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:35,715 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:35,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:35,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,716 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,716 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:35,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:35,716 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:35,716 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:35,716 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:35,716 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:35,716 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:35,716 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:35,717 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. started... 2023-10-30 06:53:35,717 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 43679c57208aa4c0c4684e9c52821d7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:36,143 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120557bb37d7f2184b90a3f35d2ff9037b1b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120557bb37d7f2184b90a3f35d2ff9037b1b 2023-10-30 06:53:36,553 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/60db1def226f4bffa0dcd2ad70762a18 2023-10-30 06:53:36,565 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/60db1def226f4bffa0dcd2ad70762a18 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/60db1def226f4bffa0dcd2ad70762a18 2023-10-30 06:53:36,571 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/60db1def226f4bffa0dcd2ad70762a18, entries=1, sequenceid=17, filesize=4.9 K 2023-10-30 06:53:36,572 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43679c57208aa4c0c4684e9c52821d7e in 855ms, sequenceid=17, compaction requested=true 2023-10-30 06:53:36,573 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:36,573 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:36,573 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:36,573 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:36,573 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,573 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:36,573 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:36,574 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,574 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:36,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:36,574 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,575 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:36,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:36,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:36,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:36,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:36,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61e76923[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:36,576 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:36,576 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,577 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,577 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:36,577 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:36,577 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:36,577 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,577 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:36,578 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:36,578 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:36,578 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:36,578 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:36,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:36,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:36,581 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:36,581 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:36,581 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:36,581 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,581 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:36,582 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,582 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:36,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,582 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:36,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:36,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:36,583 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:36,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,584 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:36,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,586 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,586 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:36,586 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:36,586 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:36,586 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:36,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:36,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:36,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:36,586 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,587 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,587 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,587 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,587 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,587 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:36,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:36,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:36,587 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:36,687 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:36,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:36,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:36,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:36,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,701 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:36,701 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:36,701 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:36,701 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:36,702 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,702 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,704 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,704 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:36,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:36,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:36,705 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:36,705 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:36,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:36,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,706 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,706 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:36,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:36,706 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:36,706 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:36,706 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:36,707 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:36,707 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:36,707 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:36,707 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. started... 2023-10-30 06:53:36,707 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 43679c57208aa4c0c4684e9c52821d7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:37,130 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512280b1c7f1d28af4a97b1596a2b642fb809 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512280b1c7f1d28af4a97b1596a2b642fb809 2023-10-30 06:53:37,277 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 06:53:37,538 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/d48ba947fa134fe482bc9f6d5d20577d 2023-10-30 06:53:37,553 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/d48ba947fa134fe482bc9f6d5d20577d as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/d48ba947fa134fe482bc9f6d5d20577d 2023-10-30 06:53:37,560 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/d48ba947fa134fe482bc9f6d5d20577d, entries=1, sequenceid=21, filesize=4.9 K 2023-10-30 06:53:37,561 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43679c57208aa4c0c4684e9c52821d7e in 854ms, sequenceid=21, compaction requested=true 2023-10-30 06:53:37,561 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:37,561 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:37,561 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:37,561 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:37,561 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,561 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:37,561 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:37,563 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,563 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:37,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:37,564 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,564 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:37,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:37,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:37,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:37,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:37,566 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:37,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@863265c[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:37,566 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,567 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,567 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:37,567 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:37,567 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:37,567 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,567 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:37,568 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:37,568 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,568 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:37,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:37,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:37,568 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:37,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:37,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:37,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:37,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:37,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:37,570 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:37,570 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:37,570 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:37,570 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,570 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:37,571 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,571 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:37,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:37,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,571 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:37,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:37,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:37,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:37,572 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:37,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,573 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:37,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,575 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,575 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,575 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:37,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:37,575 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:37,575 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:37,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:37,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:37,575 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:37,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:37,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:37,575 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 06:53:37,575 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,575 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:37,575 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,575 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:37,575 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,676 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:37,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:37,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:37,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:37,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,692 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:37,692 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:37,692 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:37,692 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:37,693 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,693 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,695 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,695 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:37,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:37,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:37,696 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:37,696 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:37,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:37,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,699 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,699 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:37,699 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:37,699 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:37,699 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:37,700 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:37,700 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:37,700 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:37,700 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:37,700 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. started... 2023-10-30 06:53:37,700 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 43679c57208aa4c0c4684e9c52821d7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:38,129 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231645b65f13b9442bca835d9af3f3cf179 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231645b65f13b9442bca835d9af3f3cf179 2023-10-30 06:53:38,536 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/dd299d84b3024d429596d42e4821afba 2023-10-30 06:53:38,548 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/dd299d84b3024d429596d42e4821afba as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/dd299d84b3024d429596d42e4821afba 2023-10-30 06:53:38,556 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/dd299d84b3024d429596d42e4821afba, entries=1, sequenceid=25, filesize=4.9 K 2023-10-30 06:53:38,557 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43679c57208aa4c0c4684e9c52821d7e in 857ms, sequenceid=25, compaction requested=true 2023-10-30 06:53:38,557 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:38,557 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:38,557 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:38,557 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:38,557 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,558 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:38,558 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:38,559 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,559 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:38,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:38,560 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,560 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:38,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:38,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:38,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:38,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:38,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@490aea70[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:38,562 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:38,562 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,564 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,564 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:38,564 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:38,564 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:38,564 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,564 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:38,565 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,565 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:38,566 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:38,566 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:38,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:38,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:38,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:38,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:38,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:38,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:38,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:38,570 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:38,570 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:38,570 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:38,571 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,571 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:38,583 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,584 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,584 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:38,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:38,585 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:38,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,588 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:38,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,593 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,593 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,593 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:38,593 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,593 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:38,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:38,593 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:38,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:38,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:38,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 06:53:38,593 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:38,594 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:38,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:38,594 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,594 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,594 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:38,594 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:38,695 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:38,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:38,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:38,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:38,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,711 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:38,711 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:38,711 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:38,711 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:38,712 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,712 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,713 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:38,713 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:38,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:38,714 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:38,714 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:38,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:38,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,715 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,715 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:38,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:38,715 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:38,715 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:38,715 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:38,715 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:38,715 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:38,716 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:38,716 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. started... 2023-10-30 06:53:38,716 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 43679c57208aa4c0c4684e9c52821d7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:39,141 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101533a8beebee4429eb9f5333aba7a8849 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101533a8beebee4429eb9f5333aba7a8849 2023-10-30 06:53:39,550 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/27c61071e52b4b21aa8dc8e8b67d1f78 2023-10-30 06:53:39,560 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/27c61071e52b4b21aa8dc8e8b67d1f78 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/27c61071e52b4b21aa8dc8e8b67d1f78 2023-10-30 06:53:39,568 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/27c61071e52b4b21aa8dc8e8b67d1f78, entries=1, sequenceid=29, filesize=4.9 K 2023-10-30 06:53:39,569 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43679c57208aa4c0c4684e9c52821d7e in 853ms, sequenceid=29, compaction requested=true 2023-10-30 06:53:39,569 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:39,569 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:39,569 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:39,569 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:39,569 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,569 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:39,569 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:39,571 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,571 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:39,572 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,572 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:39,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:39,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:39,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24105f1d[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:39,574 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:39,574 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,576 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,576 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:39,576 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:39,576 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:39,576 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,576 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:39,577 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:39,577 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:39,577 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,577 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:39,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:39,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:39,582 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:39,582 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:39,582 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:39,582 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,582 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:39,589 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,589 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,589 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:39,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:39,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:39,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:39,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:39,590 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:39,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:39,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,592 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:39,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,601 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,601 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,601 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,601 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,601 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:39,602 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:39,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 06:53:39,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:39,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:39,602 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:39,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:39,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:39,601 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,602 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,602 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:39,603 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:39,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:39,603 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:39,703 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:39,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:39,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:39,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:39,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,717 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:39,717 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:39,717 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:39,717 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:39,718 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,718 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,719 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,719 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:39,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:39,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:39,720 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:39,720 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,721 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,721 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:39,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:39,721 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:39,721 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:39,721 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:39,722 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:39,722 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:39,722 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:39,722 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. started... 2023-10-30 06:53:39,722 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 43679c57208aa4c0c4684e9c52821d7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:40,142 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034e0d1467ebe34d0cb3c5f5b8059d8795 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601034e0d1467ebe34d0cb3c5f5b8059d8795 2023-10-30 06:53:40,550 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/7c2ea4d6a9d3497186e74dfc3aba3fe4 2023-10-30 06:53:40,555 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/7c2ea4d6a9d3497186e74dfc3aba3fe4 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/7c2ea4d6a9d3497186e74dfc3aba3fe4 2023-10-30 06:53:40,561 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/7c2ea4d6a9d3497186e74dfc3aba3fe4, entries=1, sequenceid=33, filesize=4.9 K 2023-10-30 06:53:40,562 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43679c57208aa4c0c4684e9c52821d7e in 840ms, sequenceid=33, compaction requested=true 2023-10-30 06:53:40,562 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:40,562 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:40,562 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:40,562 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:40,562 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,563 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:40,563 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:40,564 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,564 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:40,564 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,565 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:40,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:40,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:40,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:40,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:40,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ee484cd[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:40,566 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:40,567 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,567 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,568 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:40,568 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:40,568 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:40,568 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,568 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:40,569 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:40,569 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,569 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:40,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:40,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:40,569 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:40,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:40,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:40,572 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:40,572 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:40,572 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:40,572 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,572 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:40,573 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,573 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:40,573 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:40,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:40,574 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,575 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,576 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,576 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,576 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:40,576 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:40,576 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 06:53:40,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:40,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:40,576 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:40,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:40,577 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:40,577 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,577 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,577 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:40,577 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:40,577 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:40,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:40,677 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:40,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:40,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:40,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:40,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,691 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:40,691 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:40,691 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:40,691 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:40,692 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,693 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,694 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,694 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:40,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:40,694 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:40,694 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:40,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:40,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,695 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,695 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:40,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:40,696 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:40,696 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:40,696 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:40,696 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:40,696 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:40,696 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:40,696 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. started... 2023-10-30 06:53:40,696 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 43679c57208aa4c0c4684e9c52821d7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:41,122 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907db9aee59b4ab4c34be1d0c432847468e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907db9aee59b4ab4c34be1d0c432847468e 2023-10-30 06:53:41,532 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/564c639595014dc1a8186a8700737bd0 2023-10-30 06:53:41,544 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/564c639595014dc1a8186a8700737bd0 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/564c639595014dc1a8186a8700737bd0 2023-10-30 06:53:41,549 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/564c639595014dc1a8186a8700737bd0, entries=1, sequenceid=37, filesize=4.9 K 2023-10-30 06:53:41,550 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43679c57208aa4c0c4684e9c52821d7e in 854ms, sequenceid=37, compaction requested=true 2023-10-30 06:53:41,550 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:41,550 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:41,550 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:41,550 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:41,550 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,550 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:41,550 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:41,552 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,552 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:41,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:41,552 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,552 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:41,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:41,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:41,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:41,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:41,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f241c8b[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:41,554 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:41,554 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,554 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,555 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:41,555 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:41,555 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:41,555 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,555 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:41,556 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:41,556 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:41,556 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,556 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:41,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:41,558 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:41,558 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:41,558 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:41,558 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,558 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:41,559 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,559 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:41,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,559 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:41,559 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,560 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,561 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,561 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,561 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:41,561 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:41,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:41,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:41,561 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:41,561 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:41,561 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,562 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,562 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:41,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:41,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:41,562 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,562 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:41,562 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,662 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:41,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:41,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:41,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:41,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,668 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:41,668 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:41,668 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 06:53:41,668 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 06:53:41,669 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,669 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,670 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:41,670 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:41,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:41,670 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:41,670 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:41,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:41,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,671 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,671 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 06:53:41,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:41,671 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 06:53:41,671 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:41,671 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 06:53:41,671 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:41,671 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:41,671 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:41,672 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. started... 2023-10-30 06:53:41,672 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 43679c57208aa4c0c4684e9c52821d7e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:42,091 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a9cdeb2b3c154227b28223cb7da055cc to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120a9cdeb2b3c154227b28223cb7da055cc 2023-10-30 06:53:42,500 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/10b7ce6466e74482be846b26db34c710 2023-10-30 06:53:42,513 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/10b7ce6466e74482be846b26db34c710 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/10b7ce6466e74482be846b26db34c710 2023-10-30 06:53:42,520 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/10b7ce6466e74482be846b26db34c710, entries=1, sequenceid=41, filesize=4.9 K 2023-10-30 06:53:42,521 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 43679c57208aa4c0c4684e9c52821d7e in 849ms, sequenceid=41, compaction requested=true 2023-10-30 06:53:42,521 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:42,521 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:42,521 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:42,521 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:42,521 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,521 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 06:53:42,521 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 06:53:42,523 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,523 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:42,524 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:42,524 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:42,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:42,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:42,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 06:53:42,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71e33275[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:42,526 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 06:53:42,527 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,527 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,528 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 06:53:42,528 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 06:53:42,528 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:42,528 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,528 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:42,529 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 06:53:42,529 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,529 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:42,529 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 06:53:42,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:42,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:42,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:42,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:42,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:42,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:53:42,534 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 06:53:42,534 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:42,534 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:42,534 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,534 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:42,541 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,541 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:42,542 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:42,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:42,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,542 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:42,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:42,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:42,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:42,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,543 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:42,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,548 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,548 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,548 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:42,548 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,548 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:42,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 06:53:42,548 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:42,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 06:53:42,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:42,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:42,548 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:42,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:42,548 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,549 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,549 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,549 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:42,549 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:42,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:42,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:42,649 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:42,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:42,652 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-10-30 06:53:42,654 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 06:53:42,655 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 06:53:42,656 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:42,656 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649422656 2023-10-30 06:53:42,659 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 06:53:42,660 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-10-30 06:53:42,660 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 06:53:42,662 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x17dbddd4 to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:53:42,666 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d44392f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:53:42,666 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:43,513 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030259f4d7d27c4b6693dc814acb31d561 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601030259f4d7d27c4b6693dc814acb31d561 2023-10-30 06:53:43,514 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 06:53:43,528 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:53:43,529 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:53:43,536 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:53:43,537 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:53:43,545 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/fe78523615da44dd8df5cf6216761ee5 first=Optional[r3] last=Optional[r6] 2023-10-30 06:53:43,546 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/fe78523615da44dd8df5cf6216761ee5}] 2023-10-30 06:53:43,551 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/fe78523615da44dd8df5cf6216761ee5 for inclusion in 43679c57208aa4c0c4684e9c52821d7e/family1 2023-10-30 06:53:43,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 06:53:43,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:53:43,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:43,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/fe78523615da44dd8df5cf6216761ee5 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyPolicy__aj4ch8tnci702j45n48nd76m4nd7sknqhu2tkeqe8qtfip8mn1qt14uvblpj1ns8/family1/fe78523615da44dd8df5cf6216761ee5 2023-10-30 06:53:43,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyPolicy__aj4ch8tnci702j45n48nd76m4nd7sknqhu2tkeqe8qtfip8mn1qt14uvblpj1ns8/family1/fe78523615da44dd8df5cf6216761ee5 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/9174b02646a44f87a45bd269520f9c41_SeqId_44_ 2023-10-30 06:53:43,559 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyPolicy__aj4ch8tnci702j45n48nd76m4nd7sknqhu2tkeqe8qtfip8mn1qt14uvblpj1ns8/family1/fe78523615da44dd8df5cf6216761ee5 into 43679c57208aa4c0c4684e9c52821d7e/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/9174b02646a44f87a45bd269520f9c41_SeqId_44_ - updating store file list. 2023-10-30 06:53:43,564 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/9174b02646a44f87a45bd269520f9c41_SeqId_44_ into 43679c57208aa4c0c4684e9c52821d7e/family1 2023-10-30 06:53:43,564 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyPolicy__aj4ch8tnci702j45n48nd76m4nd7sknqhu2tkeqe8qtfip8mn1qt14uvblpj1ns8/family1/fe78523615da44dd8df5cf6216761ee5 into 43679c57208aa4c0c4684e9c52821d7e/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/9174b02646a44f87a45bd269520f9c41_SeqId_44_) 2023-10-30 06:53:43,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyPolicy__aj4ch8tnci702j45n48nd76m4nd7sknqhu2tkeqe8qtfip8mn1qt14uvblpj1ns8/family1/fe78523615da44dd8df5cf6216761ee5 2023-10-30 06:53:43,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 06:53:43,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 06:53:43,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(1912): 43679c57208aa4c0c4684e9c52821d7e/family1 is initiating minor compaction 2023-10-30 06:53:43,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2fb592b1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:43,569 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 43679c57208aa4c0c4684e9c52821d7e/family1 in testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:43,570 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/3bee7e7dd97c4ab48f41682cb7f86bad, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/c3b948d5c18d45f086e4d1feb3d4714c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/60db1def226f4bffa0dcd2ad70762a18, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/d48ba947fa134fe482bc9f6d5d20577d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/dd299d84b3024d429596d42e4821afba, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/27c61071e52b4b21aa8dc8e8b67d1f78, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/7c2ea4d6a9d3497186e74dfc3aba3fe4, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/564c639595014dc1a8186a8700737bd0, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/10b7ce6466e74482be846b26db34c710, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/9174b02646a44f87a45bd269520f9c41_SeqId_44_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp, totalSize=50.0 K 2023-10-30 06:53:43,570 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 3bee7e7dd97c4ab48f41682cb7f86bad, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 06:53:43,570 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting c3b948d5c18d45f086e4d1feb3d4714c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 06:53:43,570 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 60db1def226f4bffa0dcd2ad70762a18, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 06:53:43,570 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting d48ba947fa134fe482bc9f6d5d20577d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 06:53:43,570 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting dd299d84b3024d429596d42e4821afba, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 06:53:43,570 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 27c61071e52b4b21aa8dc8e8b67d1f78, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 06:53:43,570 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 7c2ea4d6a9d3497186e74dfc3aba3fe4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 06:53:43,570 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 564c639595014dc1a8186a8700737bd0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 06:53:43,570 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 10b7ce6466e74482be846b26db34c710, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 06:53:43,571 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 9174b02646a44f87a45bd269520f9c41_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 06:53:43,572 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 06:53:43,573 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:43,575 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512280b1c7f1d28af4a97b1596a2b642fb809 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512280b1c7f1d28af4a97b1596a2b642fb809 2023-10-30 06:53:43,576 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231645b65f13b9442bca835d9af3f3cf179 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231645b65f13b9442bca835d9af3f3cf179 2023-10-30 06:53:43,578 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101533a8beebee4429eb9f5333aba7a8849 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101533a8beebee4429eb9f5333aba7a8849 2023-10-30 06:53:43,579 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601034e0d1467ebe34d0cb3c5f5b8059d8795 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601034e0d1467ebe34d0cb3c5f5b8059d8795 2023-10-30 06:53:43,579 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-10-30 06:53:43,579 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 06:53:43,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:43,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:43,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:43,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:43,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:43,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:43,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:43,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:43,610 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): 43679c57208aa4c0c4684e9c52821d7e#family1#compaction#48 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:53:44,442 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/bc3d07575a1e4bc8babe9c85baf3cfff as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/bc3d07575a1e4bc8babe9c85baf3cfff 2023-10-30 06:53:44,449 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120542cfdbf4cf224008817e87fb891ead19 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120542cfdbf4cf224008817e87fb891ead19 2023-10-30 06:53:44,452 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 06:53:44,452 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 43679c57208aa4c0c4684e9c52821d7e/family1 of 43679c57208aa4c0c4684e9c52821d7e into bc3d07575a1e4bc8babe9c85baf3cfff(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:53:44,452 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:44,452 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698648823569; duration=0sec 2023-10-30 06:53:44,452 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:44,483 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5fafd462fd140919340c286e03dfd79 first=Optional[r00] last=Optional[r2] 2023-10-30 06:53:44,484 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5fafd462fd140919340c286e03dfd79}] 2023-10-30 06:53:44,488 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5fafd462fd140919340c286e03dfd79 for inclusion in 43679c57208aa4c0c4684e9c52821d7e/family1 2023-10-30 06:53:44,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-30 06:53:44,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:53:44,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:44,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5fafd462fd140919340c286e03dfd79 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sllin11dnmnn92sa9tuli94bp6itpilreujtjtg2iso7a69c55mejiutucb2bkmh/family1/f5fafd462fd140919340c286e03dfd79 2023-10-30 06:53:44,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sllin11dnmnn92sa9tuli94bp6itpilreujtjtg2iso7a69c55mejiutucb2bkmh/family1/f5fafd462fd140919340c286e03dfd79 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/8225deaf715841d381612276dbb06077_SeqId_47_ 2023-10-30 06:53:44,495 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sllin11dnmnn92sa9tuli94bp6itpilreujtjtg2iso7a69c55mejiutucb2bkmh/family1/f5fafd462fd140919340c286e03dfd79 into 43679c57208aa4c0c4684e9c52821d7e/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/8225deaf715841d381612276dbb06077_SeqId_47_ - updating store file list. 2023-10-30 06:53:44,499 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/8225deaf715841d381612276dbb06077_SeqId_47_ into 43679c57208aa4c0c4684e9c52821d7e/family1 2023-10-30 06:53:44,499 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sllin11dnmnn92sa9tuli94bp6itpilreujtjtg2iso7a69c55mejiutucb2bkmh/family1/f5fafd462fd140919340c286e03dfd79 into 43679c57208aa4c0c4684e9c52821d7e/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/8225deaf715841d381612276dbb06077_SeqId_47_) 2023-10-30 06:53:44,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyPolicy__sllin11dnmnn92sa9tuli94bp6itpilreujtjtg2iso7a69c55mejiutucb2bkmh/family1/f5fafd462fd140919340c286e03dfd79 2023-10-30 06:53:44,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 06:53:44,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 06:53:44,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(1912): 43679c57208aa4c0c4684e9c52821d7e/family1 is initiating minor compaction (all files) 2023-10-30 06:53:44,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2a283d88; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-30 06:53:44,501 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 43679c57208aa4c0c4684e9c52821d7e/family1 in testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:53:44,501 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/8a16f80850174d6f912c886c98449a96, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/bc3d07575a1e4bc8babe9c85baf3cfff, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/8225deaf715841d381612276dbb06077_SeqId_47_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp, totalSize=337.0 K 2023-10-30 06:53:44,502 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 8a16f80850174d6f912c886c98449a96, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878849956 2023-10-30 06:53:44,502 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting bc3d07575a1e4bc8babe9c85baf3cfff, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621249956 2023-10-30 06:53:44,503 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 8225deaf715841d381612276dbb06077_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878849956 2023-10-30 06:53:44,503 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 06:53:44,504 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:44,505 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130096bb23cebbb4ce4818bf11d049a5729 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130096bb23cebbb4ce4818bf11d049a5729 2023-10-30 06:53:44,506 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512013b08d9bcbdcb41509be1144a567c4505 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512013b08d9bcbdcb41509be1144a567c4505 2023-10-30 06:53:44,507 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120557bb37d7f2184b90a3f35d2ff9037b1b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120557bb37d7f2184b90a3f35d2ff9037b1b 2023-10-30 06:53:44,507 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-10-30 06:53:44,508 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 06:53:44,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 06:53:44,508 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 06:53:44,508 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:44,509 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 06:53:44,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8560 sec 2023-10-30 06:53:44,520 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): 43679c57208aa4c0c4684e9c52821d7e#family1#compaction#49 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:53:44,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/3bee7e7dd97c4ab48f41682cb7f86bad, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/c3b948d5c18d45f086e4d1feb3d4714c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/60db1def226f4bffa0dcd2ad70762a18, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/d48ba947fa134fe482bc9f6d5d20577d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/dd299d84b3024d429596d42e4821afba, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/27c61071e52b4b21aa8dc8e8b67d1f78, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/7c2ea4d6a9d3497186e74dfc3aba3fe4, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/564c639595014dc1a8186a8700737bd0, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/10b7ce6466e74482be846b26db34c710, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/9174b02646a44f87a45bd269520f9c41_SeqId_44_] to archive 2023-10-30 06:53:44,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:44,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/3bee7e7dd97c4ab48f41682cb7f86bad to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/3bee7e7dd97c4ab48f41682cb7f86bad 2023-10-30 06:53:44,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/c3b948d5c18d45f086e4d1feb3d4714c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/c3b948d5c18d45f086e4d1feb3d4714c 2023-10-30 06:53:44,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/60db1def226f4bffa0dcd2ad70762a18 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/60db1def226f4bffa0dcd2ad70762a18 2023-10-30 06:53:44,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/d48ba947fa134fe482bc9f6d5d20577d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/d48ba947fa134fe482bc9f6d5d20577d 2023-10-30 06:53:44,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/dd299d84b3024d429596d42e4821afba to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/dd299d84b3024d429596d42e4821afba 2023-10-30 06:53:44,569 DEBUG [hfile_cleaner-dir-scan-pool-0] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 29 more 2023-10-30 06:53:44,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/27c61071e52b4b21aa8dc8e8b67d1f78 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/27c61071e52b4b21aa8dc8e8b67d1f78 2023-10-30 06:53:44,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/7c2ea4d6a9d3497186e74dfc3aba3fe4 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/7c2ea4d6a9d3497186e74dfc3aba3fe4 2023-10-30 06:53:44,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/564c639595014dc1a8186a8700737bd0 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/564c639595014dc1a8186a8700737bd0 2023-10-30 06:53:44,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/10b7ce6466e74482be846b26db34c710 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/10b7ce6466e74482be846b26db34c710 2023-10-30 06:53:44,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/9174b02646a44f87a45bd269520f9c41_SeqId_44_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/9174b02646a44f87a45bd269520f9c41_SeqId_44_ 2023-10-30 06:53:44,650 INFO [Listener at localhost/40811] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=256 (was 257), OpenFileDescriptor=621 (was 604) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=198 (was 244), ProcessCount=168 (was 168), AvailableMemoryMB=2702 (was 2721) 2023-10-30 06:53:44,661 INFO [Listener at localhost/40811] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=256, OpenFileDescriptor=621, MaxFileDescriptor=60000, SystemLoadAverage=198, ProcessCount=168, AvailableMemoryMB=2701 2023-10-30 06:53:44,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 06:53:44,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:44,667 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 06:53:44,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-10-30 06:53:44,668 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 06:53:44,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 06:53:44,669 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:44,670 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e empty. 2023-10-30 06:53:44,670 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:44,670 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-10-30 06:53:44,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 06:53:44,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 06:53:45,082 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-10-30 06:53:45,083 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6c8ae1419fa390e22431c371aa66933e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:53:45,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 06:53:45,490 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:45,490 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 6c8ae1419fa390e22431c371aa66933e, disabling compactions & flushes 2023-10-30 06:53:45,490 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:45,490 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:45,490 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. after waiting 0 ms 2023-10-30 06:53:45,491 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:45,491 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:45,491 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:45,493 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 06:53:45,494 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698648825494"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648825494"}]},"ts":"1698648825494"} 2023-10-30 06:53:45,496 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 06:53:45,496 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 06:53:45,497 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648825496"}]},"ts":"1698648825496"} 2023-10-30 06:53:45,498 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-10-30 06:53:45,500 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6c8ae1419fa390e22431c371aa66933e, ASSIGN}] 2023-10-30 06:53:45,502 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6c8ae1419fa390e22431c371aa66933e, ASSIGN 2023-10-30 06:53:45,502 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6c8ae1419fa390e22431c371aa66933e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:53:45,653 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6c8ae1419fa390e22431c371aa66933e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:45,654 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698648825653"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648825653"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648825653"}]},"ts":"1698648825653"} 2023-10-30 06:53:45,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 6c8ae1419fa390e22431c371aa66933e, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:53:45,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 06:53:45,776 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/.tmp/family1/1c71980c757946c6ab82ce39bf81a7fa as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/1c71980c757946c6ab82ce39bf81a7fa 2023-10-30 06:53:45,782 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 43679c57208aa4c0c4684e9c52821d7e/family1 of 43679c57208aa4c0c4684e9c52821d7e into 1c71980c757946c6ab82ce39bf81a7fa(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:53:45,782 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:53:45,782 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1698648824501; duration=1sec 2023-10-30 06:53:45,782 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:45,808 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:45,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:45,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6c8ae1419fa390e22431c371aa66933e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:53:45,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:45,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:45,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:45,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:45,812 INFO [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:45,813 DEBUG [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1 2023-10-30 06:53:45,813 DEBUG [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1 2023-10-30 06:53:45,814 INFO [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c8ae1419fa390e22431c371aa66933e columnFamilyName family1 2023-10-30 06:53:45,815 INFO [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] regionserver.HStore(310): Store=6c8ae1419fa390e22431c371aa66933e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:53:45,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:45,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:45,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:45,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:53:45,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6c8ae1419fa390e22431c371aa66933e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61554881, jitterRate=-0.08276079595088959}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:53:45,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:45,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e., pid=41, masterSystemTime=1698648825807 2023-10-30 06:53:45,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:45,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:45,823 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6c8ae1419fa390e22431c371aa66933e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:45,823 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698648825823"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648825823"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648825823"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648825823"}]},"ts":"1698648825823"} 2023-10-30 06:53:45,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-10-30 06:53:45,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 6c8ae1419fa390e22431c371aa66933e, server=jenkins-hbase20.apache.org,40611,1698648765457 in 168 msec 2023-10-30 06:53:45,827 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-10-30 06:53:45,827 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6c8ae1419fa390e22431c371aa66933e, ASSIGN in 326 msec 2023-10-30 06:53:45,828 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 06:53:45,828 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648825828"}]},"ts":"1698648825828"} 2023-10-30 06:53:45,829 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-10-30 06:53:45,831 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 06:53:45,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1670 sec 2023-10-30 06:53:45,840 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/8a16f80850174d6f912c886c98449a96, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/bc3d07575a1e4bc8babe9c85baf3cfff, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/8225deaf715841d381612276dbb06077_SeqId_47_] to archive 2023-10-30 06:53:45,841 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:45,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/8a16f80850174d6f912c886c98449a96 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/8a16f80850174d6f912c886c98449a96 2023-10-30 06:53:45,843 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/bc3d07575a1e4bc8babe9c85baf3cfff to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/bc3d07575a1e4bc8babe9c85baf3cfff 2023-10-30 06:53:45,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/8225deaf715841d381612276dbb06077_SeqId_47_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/family1/8225deaf715841d381612276dbb06077_SeqId_47_ 2023-10-30 06:53:46,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 06:53:46,774 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-10-30 06:53:46,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:46,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:46,800 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:46,800 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:46,800 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 06:53:46,800 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 06:53:46,800 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:46,801 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:46,801 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:46,801 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:46,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:46,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:46,801 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:46,801 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:46,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:46,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:46,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:46,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:46,802 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:46,802 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:46,803 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 06:53:46,803 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:46,803 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 06:53:46,806 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:46,807 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:46,807 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:46,807 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. started... 2023-10-30 06:53:46,807 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6c8ae1419fa390e22431c371aa66933e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 06:53:46,907 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:47,232 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c903d7e023934a9b8eee12caba8e7126 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130c903d7e023934a9b8eee12caba8e7126 2023-10-30 06:53:47,636 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/f4861fbae7da41b2a084c85f35d97cc0 2023-10-30 06:53:47,643 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/f4861fbae7da41b2a084c85f35d97cc0 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/f4861fbae7da41b2a084c85f35d97cc0 2023-10-30 06:53:47,648 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/f4861fbae7da41b2a084c85f35d97cc0, entries=1000, sequenceid=5, filesize=191.4 K 2023-10-30 06:53:47,649 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 6c8ae1419fa390e22431c371aa66933e in 841ms, sequenceid=5, compaction requested=false 2023-10-30 06:53:47,649 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:47,649 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:47,649 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:47,649 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:47,649 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,649 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 06:53:47,649 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 06:53:47,650 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,650 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:47,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:47,651 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,651 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:47,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:47,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:47,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:47,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 06:53:47,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57ad63e3[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:47,652 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 06:53:47,652 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,653 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,653 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 06:53:47,653 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,653 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:47,653 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 06:53:47,653 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:47,654 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:47,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:47,654 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 06:53:47,654 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:47,654 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 06:53:47,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:47,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:47,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:47,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:47,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 06:53:47,656 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 06:53:47,656 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:47,656 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:47,656 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,656 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:47,657 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,657 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:47,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,657 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:47,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:47,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:47,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:47,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:47,658 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:47,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,659 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:47,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,661 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,661 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:47,661 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,661 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:47,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 06:53:47,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:47,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:47,661 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:47,661 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:47,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:47,661 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,661 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,661 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,661 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,661 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:47,661 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:47,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:47,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:47,762 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:47,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:47,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:47,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:47,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,768 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:47,769 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:47,769 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 06:53:47,769 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 06:53:47,769 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,769 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,770 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,770 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:47,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:47,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:47,770 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:47,770 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:47,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:47,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,771 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,771 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 06:53:47,771 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:47,771 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 06:53:47,771 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:47,771 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 06:53:47,771 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:47,771 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:47,771 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:47,771 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. started... 2023-10-30 06:53:47,772 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6c8ae1419fa390e22431c371aa66933e 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 06:53:48,185 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283d4de0d821834b65a2d4ff6934069a2c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511283d4de0d821834b65a2d4ff6934069a2c 2023-10-30 06:53:48,591 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/7e91ba98478047ecbb29d23a7afaa52c 2023-10-30 06:53:48,599 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/7e91ba98478047ecbb29d23a7afaa52c as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/7e91ba98478047ecbb29d23a7afaa52c 2023-10-30 06:53:48,605 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/7e91ba98478047ecbb29d23a7afaa52c, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 06:53:48,607 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 6c8ae1419fa390e22431c371aa66933e in 835ms, sequenceid=9, compaction requested=false 2023-10-30 06:53:48,607 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:48,607 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:48,607 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:48,607 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:48,607 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,607 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 06:53:48,607 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 06:53:48,608 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,608 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:48,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:48,609 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,609 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:48,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:48,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:48,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:48,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 06:53:48,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d355737[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:48,610 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 06:53:48,610 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,611 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,611 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 06:53:48,611 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 06:53:48,611 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,611 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:48,611 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:48,612 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 06:53:48,612 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,612 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:48,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:48,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:48,612 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 06:53:48,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:48,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:48,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:48,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:48,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 06:53:48,614 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 06:53:48,614 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:48,614 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:48,614 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,614 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:48,616 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,616 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:48,616 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,616 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:48,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:48,618 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:48,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,620 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,620 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:48,620 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:48,621 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:48,621 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:48,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:48,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:48,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:48,621 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 06:53:48,621 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,621 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,621 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,621 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:48,621 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:48,621 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:48,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:48,721 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:48,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:48,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:48,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:48,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,731 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:48,731 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:48,732 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 06:53:48,732 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 06:53:48,732 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,732 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,733 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,733 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:48,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:48,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:48,733 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:48,733 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:48,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,734 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,734 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 06:53:48,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:48,734 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 06:53:48,734 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:48,735 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 06:53:48,735 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:48,735 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:48,735 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:48,735 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. started... 2023-10-30 06:53:48,735 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6c8ae1419fa390e22431c371aa66933e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:49,158 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512019a42788286ba42cc9408ab24425f5714 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512019a42788286ba42cc9408ab24425f5714 2023-10-30 06:53:49,564 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/e3a02f9e7748445f8b84d8ab4910305e 2023-10-30 06:53:49,569 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/e3a02f9e7748445f8b84d8ab4910305e as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/e3a02f9e7748445f8b84d8ab4910305e 2023-10-30 06:53:49,574 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/e3a02f9e7748445f8b84d8ab4910305e, entries=1, sequenceid=13, filesize=5.0 K 2023-10-30 06:53:49,575 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6c8ae1419fa390e22431c371aa66933e in 840ms, sequenceid=13, compaction requested=true 2023-10-30 06:53:49,575 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:49,575 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:49,575 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:49,576 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:49,576 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,576 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 06:53:49,576 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 06:53:49,577 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,577 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:49,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:49,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:49,577 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,577 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:49,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:49,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:49,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 06:53:49,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@423ac25e[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:49,579 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 06:53:49,579 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,579 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,580 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 06:53:49,580 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 06:53:49,580 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:49,580 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,580 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:49,581 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,581 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 06:53:49,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:49,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:49,581 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:49,581 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 06:53:49,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:49,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:49,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 06:53:49,583 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 06:53:49,583 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:49,583 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:49,583 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,583 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:49,584 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,584 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:49,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:49,585 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:49,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:49,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:49,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:49,585 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:49,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,586 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:49,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,588 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,588 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:49,588 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,588 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:49,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:49,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:49,588 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:49,588 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:49,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 06:53:49,588 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:49,588 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:49,588 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,588 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:49,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:49,588 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:49,588 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,688 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:49,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:49,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:49,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:49,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,696 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:49,696 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:49,697 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 06:53:49,697 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 06:53:49,697 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,697 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,698 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:49,698 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:49,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:49,698 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,698 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:49,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:49,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,699 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,699 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 06:53:49,700 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,700 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 06:53:49,700 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:49,700 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 06:53:49,700 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:49,700 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:49,700 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:49,700 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. started... 2023-10-30 06:53:49,700 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6c8ae1419fa390e22431c371aa66933e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:49,714 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120558078227d37f4fddbd059fd1f250747f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120558078227d37f4fddbd059fd1f250747f 2023-10-30 06:53:49,719 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/ffdbd91c02c5437fa00ee32b43cd0cab 2023-10-30 06:53:49,725 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/ffdbd91c02c5437fa00ee32b43cd0cab as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/ffdbd91c02c5437fa00ee32b43cd0cab 2023-10-30 06:53:49,737 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/ffdbd91c02c5437fa00ee32b43cd0cab, entries=1, sequenceid=17, filesize=5.0 K 2023-10-30 06:53:49,739 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6c8ae1419fa390e22431c371aa66933e in 39ms, sequenceid=17, compaction requested=true 2023-10-30 06:53:49,739 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:49,739 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:49,739 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:49,739 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:49,739 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,739 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 06:53:49,739 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 06:53:49,740 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,740 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:49,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:49,741 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,741 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:49,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 06:53:49,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a2220f6[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:49,742 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 06:53:49,742 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,743 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,743 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 06:53:49,743 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 06:53:49,743 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:49,743 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,743 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:49,744 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,744 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 06:53:49,744 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:49,744 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 06:53:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:49,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 06:53:49,746 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 06:53:49,746 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:49,746 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:49,746 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,746 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:49,747 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,747 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:49,747 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:49,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:49,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:49,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:49,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:49,749 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:49,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,750 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:49,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,752 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,752 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:49,752 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,752 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:49,752 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,752 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:49,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:49,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:49,752 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:49,752 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 06:53:49,752 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:49,752 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:49,752 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,752 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:49,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:49,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:49,852 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:49,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:49,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:49,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:49,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,860 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:49,860 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:49,860 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 06:53:49,860 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 06:53:49,860 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,860 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,862 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:49,862 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:49,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:49,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,863 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:49,863 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:49,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:49,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,863 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,863 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 06:53:49,864 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:49,864 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 06:53:49,864 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:49,864 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 06:53:49,864 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:49,864 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:49,864 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:49,864 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. started... 2023-10-30 06:53:49,864 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6c8ae1419fa390e22431c371aa66933e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:49,884 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228087940597b0643b0bf2625788e311094 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228087940597b0643b0bf2625788e311094 2023-10-30 06:53:50,290 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/cf186a235cce498f99979f7055bb732b 2023-10-30 06:53:50,297 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/cf186a235cce498f99979f7055bb732b as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/cf186a235cce498f99979f7055bb732b 2023-10-30 06:53:50,307 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/cf186a235cce498f99979f7055bb732b, entries=1, sequenceid=21, filesize=5.0 K 2023-10-30 06:53:50,308 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6c8ae1419fa390e22431c371aa66933e in 444ms, sequenceid=21, compaction requested=true 2023-10-30 06:53:50,308 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:50,308 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:50,308 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:50,308 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:50,308 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,308 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 06:53:50,309 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 06:53:50,310 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,310 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:50,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:50,310 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,310 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:50,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:50,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:50,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:50,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 06:53:50,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@162cec2a[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:50,311 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 06:53:50,311 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,312 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,312 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 06:53:50,312 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 06:53:50,312 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,312 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:50,312 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:50,313 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 06:53:50,313 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,313 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:50,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,313 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 06:53:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:50,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:50,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 06:53:50,316 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 06:53:50,316 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:50,316 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:50,316 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,316 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:50,318 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,318 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,318 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:50,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:50,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,321 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,321 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,323 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,323 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,323 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:50,323 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:50,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:50,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:50,324 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,324 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,324 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,324 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,324 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:50,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:50,329 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:50,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:50,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:50,330 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:50,330 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:50,430 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:50,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:50,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:50,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:50,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,438 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:50,438 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:50,438 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 06:53:50,439 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 06:53:50,439 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,439 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,440 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:50,440 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,440 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:50,440 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:50,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:50,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:50,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:50,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,441 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,442 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 06:53:50,442 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:50,442 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 06:53:50,442 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:50,442 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 06:53:50,442 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:50,442 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:50,442 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:50,442 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. started... 2023-10-30 06:53:50,442 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6c8ae1419fa390e22431c371aa66933e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:50,866 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231125dbe6a2787452da299321fbe67099a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231125dbe6a2787452da299321fbe67099a 2023-10-30 06:53:51,273 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/875637c3e3784bc896d098c32199cf85 2023-10-30 06:53:51,287 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/875637c3e3784bc896d098c32199cf85 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/875637c3e3784bc896d098c32199cf85 2023-10-30 06:53:51,292 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/875637c3e3784bc896d098c32199cf85, entries=1, sequenceid=25, filesize=5.0 K 2023-10-30 06:53:51,293 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6c8ae1419fa390e22431c371aa66933e in 851ms, sequenceid=25, compaction requested=true 2023-10-30 06:53:51,293 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:51,293 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:51,293 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:51,293 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:51,293 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,293 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 06:53:51,293 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 06:53:51,294 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,294 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:51,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:51,295 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,295 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:51,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:51,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:51,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:51,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 06:53:51,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31879d37[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:51,296 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 06:53:51,296 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,297 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,297 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 06:53:51,297 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 06:53:51,297 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,297 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:51,297 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:51,298 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 06:53:51,298 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,298 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:51,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:51,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:51,298 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 06:53:51,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:51,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 06:53:51,300 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 06:53:51,300 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:51,300 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:51,300 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,300 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:51,301 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,301 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:51,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:51,301 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:51,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:51,302 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:51,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,303 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:51,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,304 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:51,304 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:51,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:51,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:51,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:51,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:51,304 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:51,304 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:51,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:51,305 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,305 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,305 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:51,305 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,305 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:51,305 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,305 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,305 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,346 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 06:53:51,405 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:51,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:51,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:51,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:51,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,413 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:51,413 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:51,413 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 06:53:51,413 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 06:53:51,414 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,414 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,415 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:51,415 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:51,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:51,416 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,416 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:51,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:51,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,417 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,418 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 06:53:51,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,418 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 06:53:51,418 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:51,418 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 06:53:51,418 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:51,418 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:51,418 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:51,418 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. started... 2023-10-30 06:53:51,419 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6c8ae1419fa390e22431c371aa66933e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:51,438 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010166714ca8a8a14052835fcce9aee7697b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010166714ca8a8a14052835fcce9aee7697b 2023-10-30 06:53:51,844 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/f0faafba4b5a4f15be0b4b3443865549 2023-10-30 06:53:51,849 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/f0faafba4b5a4f15be0b4b3443865549 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/f0faafba4b5a4f15be0b4b3443865549 2023-10-30 06:53:51,854 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/f0faafba4b5a4f15be0b4b3443865549, entries=1, sequenceid=29, filesize=5.0 K 2023-10-30 06:53:51,854 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6c8ae1419fa390e22431c371aa66933e in 435ms, sequenceid=29, compaction requested=true 2023-10-30 06:53:51,854 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:51,855 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:51,855 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:51,855 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:51,855 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,855 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 06:53:51,855 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 06:53:51,856 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,856 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:51,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:51,856 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,856 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:51,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:51,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:51,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:51,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 06:53:51,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@253b916b[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:51,857 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 06:53:51,857 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,858 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,858 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 06:53:51,858 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,858 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:51,858 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 06:53:51,858 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:51,860 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,860 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 06:53:51,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:51,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:51,860 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:51,860 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 06:53:51,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:51,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:51,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:51,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:51,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 06:53:51,862 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 06:53:51,862 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:51,862 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:51,862 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,862 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:51,863 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,863 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,863 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:51,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:51,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:51,863 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:51,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:51,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:51,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:51,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,864 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:51,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,865 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,865 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:51,865 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,865 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,865 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,865 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:51,865 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:51,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:51,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:51,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 06:53:51,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:51,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:51,865 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,866 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,866 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:51,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:51,866 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:51,866 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:51,966 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:51,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:51,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:51,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:51,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,972 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:51,972 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:51,973 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 06:53:51,973 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 06:53:51,973 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,973 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,974 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:51,974 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:51,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:51,974 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:51,974 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:51,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:51,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,975 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,975 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 06:53:51,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:51,975 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 06:53:51,975 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:51,975 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 06:53:51,975 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:51,976 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:51,976 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:51,976 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. started... 2023-10-30 06:53:51,976 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6c8ae1419fa390e22431c371aa66933e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:52,391 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034f6e855cb2854ff5a8dd078ddb042355 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601034f6e855cb2854ff5a8dd078ddb042355 2023-10-30 06:53:52,801 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/7f7fa084b9b24c99aeab8f5ef665d560 2023-10-30 06:53:52,814 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/7f7fa084b9b24c99aeab8f5ef665d560 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/7f7fa084b9b24c99aeab8f5ef665d560 2023-10-30 06:53:52,819 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/7f7fa084b9b24c99aeab8f5ef665d560, entries=1, sequenceid=33, filesize=5.0 K 2023-10-30 06:53:52,820 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6c8ae1419fa390e22431c371aa66933e in 844ms, sequenceid=33, compaction requested=true 2023-10-30 06:53:52,820 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:52,820 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:52,820 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:52,820 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:52,820 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,820 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 06:53:52,820 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 06:53:52,822 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,822 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:52,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:52,822 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,822 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:52,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:52,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:52,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:52,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 06:53:52,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e2520aa[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:52,824 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 06:53:52,824 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,825 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,825 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 06:53:52,825 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 06:53:52,825 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:52,825 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,825 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:52,826 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 06:53:52,827 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,827 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:52,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:52,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:52,827 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 06:53:52,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:52,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:52,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:52,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:52,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 06:53:52,830 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 06:53:52,830 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:52,831 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:52,831 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,831 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:52,832 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,832 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:52,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:52,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,832 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:52,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:52,833 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:52,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:52,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:52,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,834 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:52,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,837 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,837 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:52,837 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,837 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:52,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 06:53:52,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:52,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:52,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:52,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:52,837 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:52,837 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,838 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,838 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:52,838 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:52,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:52,838 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,838 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:52,838 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,938 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:52,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:52,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:52,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:52,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,951 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:52,951 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:52,951 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 06:53:52,951 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 06:53:52,952 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,952 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,954 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,954 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:52,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:52,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:52,955 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:52,955 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:52,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:52,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,957 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,958 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 06:53:52,958 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:52,958 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 06:53:52,958 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:52,958 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 06:53:52,959 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:52,959 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:52,959 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:52,959 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. started... 2023-10-30 06:53:52,959 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6c8ae1419fa390e22431c371aa66933e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:53,388 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907665ad87217c342828c884aaa4832624b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907665ad87217c342828c884aaa4832624b 2023-10-30 06:53:53,797 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/790cd23b3494407ebc767881b5e00171 2023-10-30 06:53:53,803 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/790cd23b3494407ebc767881b5e00171 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/790cd23b3494407ebc767881b5e00171 2023-10-30 06:53:53,809 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/790cd23b3494407ebc767881b5e00171, entries=1, sequenceid=37, filesize=5.0 K 2023-10-30 06:53:53,810 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6c8ae1419fa390e22431c371aa66933e in 851ms, sequenceid=37, compaction requested=true 2023-10-30 06:53:53,810 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:53,810 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:53,810 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:53,810 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:53,810 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,810 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 06:53:53,811 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 06:53:53,812 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,812 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:53,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:53,813 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,813 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:53,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:53,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:53,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:53,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 06:53:53,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f99d2f8[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:53,815 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 06:53:53,815 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,815 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,816 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 06:53:53,816 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 06:53:53,816 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:53,816 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,816 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:53,817 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 06:53:53,817 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:53,817 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,817 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 06:53:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:53,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:53,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:53,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:53,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:53,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 06:53:53,821 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 06:53:53,821 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:53,821 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:53,821 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,821 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:53,823 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,823 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:53,823 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:53,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:53,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:53,824 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:53,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,826 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:53,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,829 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,829 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:53,829 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,829 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:53,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:53,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:53,829 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:53,829 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,829 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:53,830 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:53,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:53,830 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,830 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:53,830 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:53,830 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,930 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:53,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:53,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:53:53,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 06:53:53,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,945 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:53,945 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:53,945 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 06:53:53,945 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 06:53:53,946 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,946 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,947 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:53,947 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:53,948 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:53,948 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:53:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:53:53,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,950 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,950 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 06:53:53,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:53,951 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 06:53:53,951 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:53:53,951 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 06:53:53,951 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:53:53,951 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:53:53,951 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:53,951 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. started... 2023-10-30 06:53:53,952 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6c8ae1419fa390e22431c371aa66933e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:53:54,375 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112016c17132659a41278fe41e95f230efaa to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112016c17132659a41278fe41e95f230efaa 2023-10-30 06:53:54,781 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/15ab1a827ba44e86952155309a8c453f 2023-10-30 06:53:54,790 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/15ab1a827ba44e86952155309a8c453f as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/15ab1a827ba44e86952155309a8c453f 2023-10-30 06:53:54,797 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/15ab1a827ba44e86952155309a8c453f, entries=1, sequenceid=41, filesize=5.0 K 2023-10-30 06:53:54,798 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6c8ae1419fa390e22431c371aa66933e in 846ms, sequenceid=41, compaction requested=true 2023-10-30 06:53:54,798 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:54,798 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:54,798 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:53:54,798 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:53:54,798 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,798 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 06:53:54,798 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 06:53:54,800 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,800 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:54,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:54,800 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,800 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:53:54,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:54,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 06:53:54,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@627a8419[Count = 0] remaining members to acquire global barrier 2023-10-30 06:53:54,802 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 06:53:54,802 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,803 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,803 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 06:53:54,803 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 06:53:54,803 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:53:54,803 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,803 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:53:54,804 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,804 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 06:53:54,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:54,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:54,804 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:54,805 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 06:53:54,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:54,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:53:54,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 06:53:54,808 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 06:53:54,808 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:53:54,808 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:53:54,808 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,808 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:53:54,814 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,814 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,814 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:54,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:53:54,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:53:54,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:54,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:53:54,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:54,815 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:53:54,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,816 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:53:54,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,825 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,825 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:53:54,825 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:53:54,825 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:53:54,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:53:54,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 06:53:54,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:53:54,825 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:53:54,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 06:53:54,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:53:54,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:53:54,825 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,826 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:54,826 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 06:53:54,826 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,826 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:53:54,826 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,826 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,926 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:53:54,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:53:54,930 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:54,932 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 06:53:54,933 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 06:53:54,934 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:54,934 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649434934 2023-10-30 06:53:54,936 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 06:53:54,938 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-30 06:53:54,938 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 06:53:54,940 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x7fa5f2ff to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:53:54,944 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73242165, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:53:54,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:55,791 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030737fdf690eb4b9c9c58e83b296d6311 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601030737fdf690eb4b9c9c58e83b296d6311 2023-10-30 06:53:55,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 06:53:55,806 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:53:55,808 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:53:55,814 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:53:55,816 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:53:55,827 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3163f70cdac849bbb5d0ea4153b2a19d first=Optional[r3] last=Optional[r6] 2023-10-30 06:53:55,828 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3163f70cdac849bbb5d0ea4153b2a19d}] 2023-10-30 06:53:55,833 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3163f70cdac849bbb5d0ea4153b2a19d for inclusion in 6c8ae1419fa390e22431c371aa66933e/family1 2023-10-30 06:53:55,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 06:53:55,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:53:55,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:55,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3163f70cdac849bbb5d0ea4153b2a19d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__sf9bgtfiiknq03dqvbns919mcv15grg3gmshq8ivit8p5fco15rba3ktlj2dq2q1/family1/3163f70cdac849bbb5d0ea4153b2a19d 2023-10-30 06:53:55,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__sf9bgtfiiknq03dqvbns919mcv15grg3gmshq8ivit8p5fco15rba3ktlj2dq2q1/family1/3163f70cdac849bbb5d0ea4153b2a19d as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/cd2ab8459fc84abdb6f4b31795251382_SeqId_44_ 2023-10-30 06:53:55,839 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__sf9bgtfiiknq03dqvbns919mcv15grg3gmshq8ivit8p5fco15rba3ktlj2dq2q1/family1/3163f70cdac849bbb5d0ea4153b2a19d into 6c8ae1419fa390e22431c371aa66933e/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/cd2ab8459fc84abdb6f4b31795251382_SeqId_44_ - updating store file list. 2023-10-30 06:53:55,842 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/cd2ab8459fc84abdb6f4b31795251382_SeqId_44_ into 6c8ae1419fa390e22431c371aa66933e/family1 2023-10-30 06:53:55,842 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__sf9bgtfiiknq03dqvbns919mcv15grg3gmshq8ivit8p5fco15rba3ktlj2dq2q1/family1/3163f70cdac849bbb5d0ea4153b2a19d into 6c8ae1419fa390e22431c371aa66933e/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/cd2ab8459fc84abdb6f4b31795251382_SeqId_44_) 2023-10-30 06:53:55,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__sf9bgtfiiknq03dqvbns919mcv15grg3gmshq8ivit8p5fco15rba3ktlj2dq2q1/family1/3163f70cdac849bbb5d0ea4153b2a19d 2023-10-30 06:53:55,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 06:53:55,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 06:53:55,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(1912): 6c8ae1419fa390e22431c371aa66933e/family1 is initiating minor compaction 2023-10-30 06:53:55,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5ca31ff6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:55,846 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6c8ae1419fa390e22431c371aa66933e/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:55,847 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/7e91ba98478047ecbb29d23a7afaa52c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/e3a02f9e7748445f8b84d8ab4910305e, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/ffdbd91c02c5437fa00ee32b43cd0cab, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/cf186a235cce498f99979f7055bb732b, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/875637c3e3784bc896d098c32199cf85, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/f0faafba4b5a4f15be0b4b3443865549, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/7f7fa084b9b24c99aeab8f5ef665d560, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/790cd23b3494407ebc767881b5e00171, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/15ab1a827ba44e86952155309a8c453f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/cd2ab8459fc84abdb6f4b31795251382_SeqId_44_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp, totalSize=50.4 K 2023-10-30 06:53:55,847 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 7e91ba98478047ecbb29d23a7afaa52c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 06:53:55,847 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting e3a02f9e7748445f8b84d8ab4910305e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 06:53:55,847 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting ffdbd91c02c5437fa00ee32b43cd0cab, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 06:53:55,847 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting cf186a235cce498f99979f7055bb732b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 06:53:55,847 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 875637c3e3784bc896d098c32199cf85, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 06:53:55,847 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting f0faafba4b5a4f15be0b4b3443865549, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 06:53:55,847 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 7f7fa084b9b24c99aeab8f5ef665d560, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 06:53:55,847 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 790cd23b3494407ebc767881b5e00171, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 06:53:55,847 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 15ab1a827ba44e86952155309a8c453f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 06:53:55,847 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting cd2ab8459fc84abdb6f4b31795251382_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 06:53:55,848 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 06:53:55,849 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:55,850 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228087940597b0643b0bf2625788e311094 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228087940597b0643b0bf2625788e311094 2023-10-30 06:53:55,852 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231125dbe6a2787452da299321fbe67099a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231125dbe6a2787452da299321fbe67099a 2023-10-30 06:53:55,853 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010166714ca8a8a14052835fcce9aee7697b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010166714ca8a8a14052835fcce9aee7697b 2023-10-30 06:53:55,854 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601034f6e855cb2854ff5a8dd078ddb042355 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601034f6e855cb2854ff5a8dd078ddb042355 2023-10-30 06:53:55,854 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-10-30 06:53:55,854 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 06:53:55,855 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:55,855 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:55,855 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:55,855 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:55,855 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:55,855 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:55,855 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:55,855 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:55,872 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6c8ae1419fa390e22431c371aa66933e#family1#compaction#60 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:53:56,696 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/1cefa2f623d14237b9263aad5796022d as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/1cefa2f623d14237b9263aad5796022d 2023-10-30 06:53:56,704 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a6b1c7fbd71d48f7bb4d2d8a97ade178 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a6b1c7fbd71d48f7bb4d2d8a97ade178 2023-10-30 06:53:56,705 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 6c8ae1419fa390e22431c371aa66933e/family1 of 6c8ae1419fa390e22431c371aa66933e into 1cefa2f623d14237b9263aad5796022d(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:53:56,705 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:56,706 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698648835846; duration=0sec 2023-10-30 06:53:56,706 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 06:53:56,706 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:56,731 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/292cab0a665849e8b257edf8e569047a first=Optional[r00] last=Optional[r2] 2023-10-30 06:53:56,731 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/292cab0a665849e8b257edf8e569047a}] 2023-10-30 06:53:56,734 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/292cab0a665849e8b257edf8e569047a for inclusion in 6c8ae1419fa390e22431c371aa66933e/family1 2023-10-30 06:53:56,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-30 06:53:56,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:53:56,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:56,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/292cab0a665849e8b257edf8e569047a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qns7gjkh0r61knpaa930u657fgkbdare5ttn0t587npplb5ov7uaui0pnt3n5rgt/family1/292cab0a665849e8b257edf8e569047a 2023-10-30 06:53:56,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qns7gjkh0r61knpaa930u657fgkbdare5ttn0t587npplb5ov7uaui0pnt3n5rgt/family1/292cab0a665849e8b257edf8e569047a as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/0d316b4dfb4445d1a6a0f7c46e85bc7c_SeqId_47_ 2023-10-30 06:53:56,743 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qns7gjkh0r61knpaa930u657fgkbdare5ttn0t587npplb5ov7uaui0pnt3n5rgt/family1/292cab0a665849e8b257edf8e569047a into 6c8ae1419fa390e22431c371aa66933e/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/0d316b4dfb4445d1a6a0f7c46e85bc7c_SeqId_47_ - updating store file list. 2023-10-30 06:53:56,748 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/0d316b4dfb4445d1a6a0f7c46e85bc7c_SeqId_47_ into 6c8ae1419fa390e22431c371aa66933e/family1 2023-10-30 06:53:56,748 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qns7gjkh0r61knpaa930u657fgkbdare5ttn0t587npplb5ov7uaui0pnt3n5rgt/family1/292cab0a665849e8b257edf8e569047a into 6c8ae1419fa390e22431c371aa66933e/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/0d316b4dfb4445d1a6a0f7c46e85bc7c_SeqId_47_) 2023-10-30 06:53:56,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__qns7gjkh0r61knpaa930u657fgkbdare5ttn0t587npplb5ov7uaui0pnt3n5rgt/family1/292cab0a665849e8b257edf8e569047a 2023-10-30 06:53:56,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 06:53:56,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 06:53:56,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(1912): 6c8ae1419fa390e22431c371aa66933e/family1 is initiating minor compaction (all files) 2023-10-30 06:53:56,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4f42be28; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:56,753 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6c8ae1419fa390e22431c371aa66933e/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:56,754 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/f4861fbae7da41b2a084c85f35d97cc0, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/1cefa2f623d14237b9263aad5796022d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/0d316b4dfb4445d1a6a0f7c46e85bc7c_SeqId_47_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp, totalSize=390.1 K 2023-10-30 06:53:56,761 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting f4861fbae7da41b2a084c85f35d97cc0, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878849956 2023-10-30 06:53:56,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/7e91ba98478047ecbb29d23a7afaa52c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/e3a02f9e7748445f8b84d8ab4910305e, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/ffdbd91c02c5437fa00ee32b43cd0cab, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/cf186a235cce498f99979f7055bb732b, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/875637c3e3784bc896d098c32199cf85, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/f0faafba4b5a4f15be0b4b3443865549, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/7f7fa084b9b24c99aeab8f5ef665d560, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/790cd23b3494407ebc767881b5e00171, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/15ab1a827ba44e86952155309a8c453f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/cd2ab8459fc84abdb6f4b31795251382_SeqId_44_] to archive 2023-10-30 06:53:56,762 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 1cefa2f623d14237b9263aad5796022d, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621249956 2023-10-30 06:53:56,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:56,763 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 0d316b4dfb4445d1a6a0f7c46e85bc7c_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878849956 2023-10-30 06:53:56,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 06:53:56,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/7e91ba98478047ecbb29d23a7afaa52c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/7e91ba98478047ecbb29d23a7afaa52c 2023-10-30 06:53:56,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/e3a02f9e7748445f8b84d8ab4910305e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/e3a02f9e7748445f8b84d8ab4910305e 2023-10-30 06:53:56,766 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:56,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/ffdbd91c02c5437fa00ee32b43cd0cab to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/ffdbd91c02c5437fa00ee32b43cd0cab 2023-10-30 06:53:56,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/cf186a235cce498f99979f7055bb732b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/cf186a235cce498f99979f7055bb732b 2023-10-30 06:53:56,768 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130c903d7e023934a9b8eee12caba8e7126 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130c903d7e023934a9b8eee12caba8e7126 2023-10-30 06:53:56,769 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512019a42788286ba42cc9408ab24425f5714 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512019a42788286ba42cc9408ab24425f5714 2023-10-30 06:53:56,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/875637c3e3784bc896d098c32199cf85 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/875637c3e3784bc896d098c32199cf85 2023-10-30 06:53:56,770 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120558078227d37f4fddbd059fd1f250747f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120558078227d37f4fddbd059fd1f250747f 2023-10-30 06:53:56,770 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-10-30 06:53:56,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/f0faafba4b5a4f15be0b4b3443865549 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/f0faafba4b5a4f15be0b4b3443865549 2023-10-30 06:53:56,771 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 06:53:56,771 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:56,771 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 06:53:56,771 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:56,772 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 06:53:56,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8410 sec 2023-10-30 06:53:56,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/7f7fa084b9b24c99aeab8f5ef665d560 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/7f7fa084b9b24c99aeab8f5ef665d560 2023-10-30 06:53:56,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/790cd23b3494407ebc767881b5e00171 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/790cd23b3494407ebc767881b5e00171 2023-10-30 06:53:56,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/15ab1a827ba44e86952155309a8c453f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/15ab1a827ba44e86952155309a8c453f 2023-10-30 06:53:56,782 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6c8ae1419fa390e22431c371aa66933e#family1#compaction#61 average throughput is 20.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:53:56,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/cd2ab8459fc84abdb6f4b31795251382_SeqId_44_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/cd2ab8459fc84abdb6f4b31795251382_SeqId_44_ 2023-10-30 06:53:56,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 06:53:56,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:57,276 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-30 06:53:57,278 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-10-30 06:53:57,278 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-30 06:53:57,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-10-30 06:53:57,283 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6c8ae1419fa390e22431c371aa66933e, REOPEN/MOVE}] 2023-10-30 06:53:57,283 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6c8ae1419fa390e22431c371aa66933e, REOPEN/MOVE 2023-10-30 06:53:57,284 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=6c8ae1419fa390e22431c371aa66933e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:57,284 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698648837284"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648837284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648837284"}]},"ts":"1698648837284"} 2023-10-30 06:53:57,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 6c8ae1419fa390e22431c371aa66933e, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:53:57,437 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:57,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:57,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6c8ae1419fa390e22431c371aa66933e, disabling compactions & flushes 2023-10-30 06:53:57,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:58,022 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/.tmp/family1/c328f1b8c80348ad8c2a991a1435e89a as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/c328f1b8c80348ad8c2a991a1435e89a 2023-10-30 06:53:58,028 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6c8ae1419fa390e22431c371aa66933e/family1 of 6c8ae1419fa390e22431c371aa66933e into c328f1b8c80348ad8c2a991a1435e89a(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:53:58,028 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:58,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:58,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:58,028 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1698648836750; duration=1sec 2023-10-30 06:53:58,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. after waiting 0 ms 2023-10-30 06:53:58,028 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:53:58,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:58,028 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/f4861fbae7da41b2a084c85f35d97cc0, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/1cefa2f623d14237b9263aad5796022d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/0d316b4dfb4445d1a6a0f7c46e85bc7c_SeqId_47_] to archive 2023-10-30 06:53:58,029 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:58,031 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/f4861fbae7da41b2a084c85f35d97cc0 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/f4861fbae7da41b2a084c85f35d97cc0 2023-10-30 06:53:58,032 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/1cefa2f623d14237b9263aad5796022d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/1cefa2f623d14237b9263aad5796022d 2023-10-30 06:53:58,033 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/0d316b4dfb4445d1a6a0f7c46e85bc7c_SeqId_47_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/0d316b4dfb4445d1a6a0f7c46e85bc7c_SeqId_47_ 2023-10-30 06:53:58,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-30 06:53:58,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:58,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:58,039 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 6c8ae1419fa390e22431c371aa66933e to self. 2023-10-30 06:53:58,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:58,041 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=6c8ae1419fa390e22431c371aa66933e, regionState=CLOSED 2023-10-30 06:53:58,041 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698648838041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648838041"}]},"ts":"1698648838041"} 2023-10-30 06:53:58,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-10-30 06:53:58,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 6c8ae1419fa390e22431c371aa66933e, server=jenkins-hbase20.apache.org,40611,1698648765457 in 757 msec 2023-10-30 06:53:58,044 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6c8ae1419fa390e22431c371aa66933e, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=true 2023-10-30 06:53:58,195 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=6c8ae1419fa390e22431c371aa66933e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:58,195 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698648838195"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648838195"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648838195"}]},"ts":"1698648838195"} 2023-10-30 06:53:58,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 6c8ae1419fa390e22431c371aa66933e, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:53:58,348 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:58,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:58,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6c8ae1419fa390e22431c371aa66933e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:53:58,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:58,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:53:58,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:58,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:58,353 INFO [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:58,354 DEBUG [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1 2023-10-30 06:53:58,354 DEBUG [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1 2023-10-30 06:53:58,354 INFO [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c8ae1419fa390e22431c371aa66933e columnFamilyName family1 2023-10-30 06:53:58,359 DEBUG [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/c328f1b8c80348ad8c2a991a1435e89a 2023-10-30 06:53:58,359 INFO [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] regionserver.HStore(310): Store=6c8ae1419fa390e22431c371aa66933e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:53:58,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:58,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:58,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:58,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6c8ae1419fa390e22431c371aa66933e; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64238433, jitterRate=-0.04277275502681732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:53:58,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:58,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e., pid=47, masterSystemTime=1698648838348 2023-10-30 06:53:58,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:58,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:58,367 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=6c8ae1419fa390e22431c371aa66933e, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:58,367 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698648838367"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648838367"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648838367"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648838367"}]},"ts":"1698648838367"} 2023-10-30 06:53:58,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-10-30 06:53:58,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 6c8ae1419fa390e22431c371aa66933e, server=jenkins-hbase20.apache.org,40611,1698648765457 in 171 msec 2023-10-30 06:53:58,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-30 06:53:58,372 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6c8ae1419fa390e22431c371aa66933e, REOPEN/MOVE in 1.0870 sec 2023-10-30 06:53:58,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-10-30 06:53:58,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0920 sec 2023-10-30 06:53:58,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5080 sec 2023-10-30 06:53:58,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-10-30 06:53:58,376 INFO [Listener at localhost/40811] compactions.TestMobCompactor(278): alter status finished 2023-10-30 06:53:58,377 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:58,378 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 06:53:58,379 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 06:53:58,379 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:58,379 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649438379 2023-10-30 06:53:58,380 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 06:53:58,381 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-30 06:53:58,381 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 06:53:58,383 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x35f55c1a to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:53:58,393 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67087cc8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:53:58,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:58,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:58,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:58,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:58,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:59,229 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128887852f5823449b6a5d456dce7677054 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128887852f5823449b6a5d456dce7677054 2023-10-30 06:53:59,230 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 06:53:59,242 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:53:59,243 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:53:59,250 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:53:59,252 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:53:59,263 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5747c51d38ee4fdca4c1e5db5705d155 first=Optional[r05] last=Optional[r8] 2023-10-30 06:53:59,264 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=51 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5747c51d38ee4fdca4c1e5db5705d155}] 2023-10-30 06:53:59,270 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5747c51d38ee4fdca4c1e5db5705d155 for inclusion in 6c8ae1419fa390e22431c371aa66933e/family1 2023-10-30 06:53:59,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-30 06:53:59,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:53:59,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:59,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5747c51d38ee4fdca4c1e5db5705d155 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mgcg6jr6cpbr9upa87kjg378gu3h1bti050oe5bornp7d8h0jv3kto87rt4o4kmh/family1/5747c51d38ee4fdca4c1e5db5705d155 2023-10-30 06:53:59,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mgcg6jr6cpbr9upa87kjg378gu3h1bti050oe5bornp7d8h0jv3kto87rt4o4kmh/family1/5747c51d38ee4fdca4c1e5db5705d155 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/2a7a05018b9849b0ac107c1c17842af4_SeqId_53_ 2023-10-30 06:53:59,278 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mgcg6jr6cpbr9upa87kjg378gu3h1bti050oe5bornp7d8h0jv3kto87rt4o4kmh/family1/5747c51d38ee4fdca4c1e5db5705d155 into 6c8ae1419fa390e22431c371aa66933e/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/2a7a05018b9849b0ac107c1c17842af4_SeqId_53_ - updating store file list. 2023-10-30 06:53:59,283 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/2a7a05018b9849b0ac107c1c17842af4_SeqId_53_ into 6c8ae1419fa390e22431c371aa66933e/family1 2023-10-30 06:53:59,283 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mgcg6jr6cpbr9upa87kjg378gu3h1bti050oe5bornp7d8h0jv3kto87rt4o4kmh/family1/5747c51d38ee4fdca4c1e5db5705d155 into 6c8ae1419fa390e22431c371aa66933e/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/2a7a05018b9849b0ac107c1c17842af4_SeqId_53_) 2023-10-30 06:53:59,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mgcg6jr6cpbr9upa87kjg378gu3h1bti050oe5bornp7d8h0jv3kto87rt4o4kmh/family1/5747c51d38ee4fdca4c1e5db5705d155 2023-10-30 06:53:59,286 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 06:53:59,287 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:53:59,289 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112016c17132659a41278fe41e95f230efaa to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112016c17132659a41278fe41e95f230efaa 2023-10-30 06:53:59,291 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511283d4de0d821834b65a2d4ff6934069a2c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511283d4de0d821834b65a2d4ff6934069a2c 2023-10-30 06:53:59,291 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-10-30 06:53:59,291 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 06:53:59,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:59,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:59,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:53:59,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 06:53:59,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:53:59,293 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 06:53:59,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 916 msec 2023-10-30 06:53:59,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 06:53:59,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:53:59,774 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-10-30 06:53:59,776 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-30 06:53:59,776 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-10-30 06:53:59,779 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-10-30 06:53:59,785 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6c8ae1419fa390e22431c371aa66933e, REOPEN/MOVE}] 2023-10-30 06:53:59,786 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6c8ae1419fa390e22431c371aa66933e, REOPEN/MOVE 2023-10-30 06:53:59,787 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=6c8ae1419fa390e22431c371aa66933e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:59,787 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698648839787"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648839787"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648839787"}]},"ts":"1698648839787"} 2023-10-30 06:53:59,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 6c8ae1419fa390e22431c371aa66933e, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:53:59,941 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:53:59,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:59,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6c8ae1419fa390e22431c371aa66933e, disabling compactions & flushes 2023-10-30 06:53:59,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:59,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:59,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. after waiting 0 ms 2023-10-30 06:53:59,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:59,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-30 06:53:59,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:53:59,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:53:59,955 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 6c8ae1419fa390e22431c371aa66933e to self. 2023-10-30 06:53:59,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:53:59,958 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=6c8ae1419fa390e22431c371aa66933e, regionState=CLOSED 2023-10-30 06:53:59,958 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698648839958"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648839958"}]},"ts":"1698648839958"} 2023-10-30 06:53:59,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-30 06:53:59,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 6c8ae1419fa390e22431c371aa66933e, server=jenkins-hbase20.apache.org,40611,1698648765457 in 170 msec 2023-10-30 06:53:59,961 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6c8ae1419fa390e22431c371aa66933e, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=true 2023-10-30 06:54:00,112 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=6c8ae1419fa390e22431c371aa66933e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:00,112 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698648840112"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648840112"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648840112"}]},"ts":"1698648840112"} 2023-10-30 06:54:00,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 6c8ae1419fa390e22431c371aa66933e, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:00,265 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:00,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:54:00,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6c8ae1419fa390e22431c371aa66933e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:54:00,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:54:00,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:00,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:54:00,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:54:00,270 INFO [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:54:00,271 DEBUG [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1 2023-10-30 06:54:00,271 DEBUG [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1 2023-10-30 06:54:00,271 INFO [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c8ae1419fa390e22431c371aa66933e columnFamilyName family1 2023-10-30 06:54:00,276 DEBUG [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/2a7a05018b9849b0ac107c1c17842af4_SeqId_53_ 2023-10-30 06:54:00,280 DEBUG [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/family1/c328f1b8c80348ad8c2a991a1435e89a 2023-10-30 06:54:00,280 INFO [StoreOpener-6c8ae1419fa390e22431c371aa66933e-1] regionserver.HStore(310): Store=6c8ae1419fa390e22431c371aa66933e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:00,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:54:00,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:54:00,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:54:00,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6c8ae1419fa390e22431c371aa66933e; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64390017, jitterRate=-0.04051397740840912}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:54:00,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:54:00,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e., pid=53, masterSystemTime=1698648840265 2023-10-30 06:54:00,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:54:00,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:54:00,287 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=6c8ae1419fa390e22431c371aa66933e, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:00,288 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698648840287"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648840287"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648840287"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648840287"}]},"ts":"1698648840287"} 2023-10-30 06:54:00,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-30 06:54:00,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 6c8ae1419fa390e22431c371aa66933e, server=jenkins-hbase20.apache.org,40611,1698648765457 in 175 msec 2023-10-30 06:54:00,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-10-30 06:54:00,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=6c8ae1419fa390e22431c371aa66933e, REOPEN/MOVE in 505 msec 2023-10-30 06:54:00,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-10-30 06:54:00,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 513 msec 2023-10-30 06:54:00,295 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 935 msec 2023-10-30 06:54:00,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-10-30 06:54:00,297 INFO [Listener at localhost/40811] compactions.TestMobCompactor(278): alter status finished 2023-10-30 06:54:00,298 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 06:54:00,299 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 06:54:00,300 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 06:54:00,301 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:54:00,301 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649440301 2023-10-30 06:54:00,302 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 06:54:00,302 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-30 06:54:00,302 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 06:54:00,304 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x3458169f to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:54:00,308 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1012d2e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:54:00,309 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:54:00,309 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:54:00,309 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:54:00,309 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:54:00,309 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:54:00,309 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:54:00,309 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:54:00,309 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 06:54:00,309 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 06:54:00,309 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:54:00,311 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 06:54:00,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 12 msec 2023-10-30 06:54:00,366 INFO [Listener at localhost/40811] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=247 (was 256), OpenFileDescriptor=622 (was 621) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=184 (was 198), ProcessCount=167 (was 168), AvailableMemoryMB=2457 (was 2701) 2023-10-30 06:54:00,379 INFO [Listener at localhost/40811] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=247, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=184, ProcessCount=167, AvailableMemoryMB=2457 2023-10-30 06:54:00,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 06:54:00,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:00,384 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 06:54:00,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-10-30 06:54:00,385 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 06:54:00,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 06:54:00,387 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:00,388 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6 empty. 2023-10-30 06:54:00,388 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:00,388 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-10-30 06:54:00,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 06:54:00,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 06:54:00,796 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-10-30 06:54:00,797 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 697de355dc3b2b8aa4f7ba137d4c52e6, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:54:00,804 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:00,804 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 697de355dc3b2b8aa4f7ba137d4c52e6, disabling compactions & flushes 2023-10-30 06:54:00,804 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:00,804 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:00,804 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. after waiting 0 ms 2023-10-30 06:54:00,804 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:00,804 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:00,805 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:00,807 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 06:54:00,808 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698648840808"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648840808"}]},"ts":"1698648840808"} 2023-10-30 06:54:00,809 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 06:54:00,810 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 06:54:00,810 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648840810"}]},"ts":"1698648840810"} 2023-10-30 06:54:00,811 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-10-30 06:54:00,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=697de355dc3b2b8aa4f7ba137d4c52e6, ASSIGN}] 2023-10-30 06:54:00,816 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=697de355dc3b2b8aa4f7ba137d4c52e6, ASSIGN 2023-10-30 06:54:00,817 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=697de355dc3b2b8aa4f7ba137d4c52e6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:54:00,968 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=697de355dc3b2b8aa4f7ba137d4c52e6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:00,968 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698648840968"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648840968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648840968"}]},"ts":"1698648840968"} 2023-10-30 06:54:00,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 697de355dc3b2b8aa4f7ba137d4c52e6, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:00,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 06:54:01,121 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:01,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 697de355dc3b2b8aa4f7ba137d4c52e6, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:54:01,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:01,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:01,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:01,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:01,126 INFO [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:01,127 DEBUG [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1 2023-10-30 06:54:01,127 DEBUG [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1 2023-10-30 06:54:01,128 INFO [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 697de355dc3b2b8aa4f7ba137d4c52e6 columnFamilyName family1 2023-10-30 06:54:01,129 INFO [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] regionserver.HStore(310): Store=697de355dc3b2b8aa4f7ba137d4c52e6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:01,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:01,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:01,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:01,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:54:01,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 697de355dc3b2b8aa4f7ba137d4c52e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66034531, jitterRate=-0.016008809208869934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:54:01,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:01,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6., pid=57, masterSystemTime=1698648841121 2023-10-30 06:54:01,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:01,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:01,139 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=697de355dc3b2b8aa4f7ba137d4c52e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,139 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698648841139"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648841139"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648841139"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648841139"}]},"ts":"1698648841139"} 2023-10-30 06:54:01,142 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-10-30 06:54:01,142 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 697de355dc3b2b8aa4f7ba137d4c52e6, server=jenkins-hbase20.apache.org,40611,1698648765457 in 170 msec 2023-10-30 06:54:01,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-10-30 06:54:01,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=697de355dc3b2b8aa4f7ba137d4c52e6, ASSIGN in 328 msec 2023-10-30 06:54:01,144 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 06:54:01,144 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648841144"}]},"ts":"1698648841144"} 2023-10-30 06:54:01,145 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-10-30 06:54:01,147 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 06:54:01,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 765 msec 2023-10-30 06:54:01,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 06:54:01,490 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-10-30 06:54:01,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:01,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,519 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:01,520 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:01,520 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 06:54:01,520 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 06:54:01,520 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,520 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,521 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,521 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:01,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:01,521 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,521 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,522 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,523 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 06:54:01,523 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:01,523 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 06:54:01,523 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:54:01,523 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:01,523 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:01,523 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. started... 2023-10-30 06:54:01,524 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 697de355dc3b2b8aa4f7ba137d4c52e6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 06:54:01,549 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130bdb55056424648a682d0ce6697b43276 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130bdb55056424648a682d0ce6697b43276 2023-10-30 06:54:01,554 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/e04e57ee3d74499589ce1278cd50db66 2023-10-30 06:54:01,558 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/e04e57ee3d74499589ce1278cd50db66 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/e04e57ee3d74499589ce1278cd50db66 2023-10-30 06:54:01,563 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/e04e57ee3d74499589ce1278cd50db66, entries=1000, sequenceid=5, filesize=190.5 K 2023-10-30 06:54:01,564 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 697de355dc3b2b8aa4f7ba137d4c52e6 in 40ms, sequenceid=5, compaction requested=false 2023-10-30 06:54:01,564 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:01,564 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:01,564 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:01,564 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:54:01,565 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:54:01,565 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,565 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 06:54:01,565 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 06:54:01,566 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,566 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:01,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:01,566 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,566 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:01,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:01,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:01,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 06:54:01,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b33f1f4[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:01,571 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 06:54:01,571 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,574 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,575 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 06:54:01,575 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 06:54:01,575 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:01,575 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,575 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:01,576 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,576 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 06:54:01,576 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:01,576 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 06:54:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:01,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:01,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:01,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:01,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:01,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 06:54:01,583 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 06:54:01,583 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:01,584 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:01,584 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,584 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:01,591 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,591 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:01,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,591 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:01,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:01,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:01,592 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:01,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:01,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,593 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:01,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:01,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:01,600 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:01,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,601 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:01,601 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:01,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 06:54:01,601 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:01,601 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:01,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:01,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:01,701 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:01,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:01,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:01,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:01,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,708 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:01,708 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:01,708 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 06:54:01,708 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 06:54:01,708 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,708 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,709 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:01,709 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:01,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:01,710 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:01,710 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:01,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:01,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,711 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,711 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 06:54:01,711 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:01,711 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 06:54:01,711 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:01,711 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 06:54:01,712 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:54:01,712 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:01,712 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:01,712 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. started... 2023-10-30 06:54:01,712 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 697de355dc3b2b8aa4f7ba137d4c52e6 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 06:54:02,126 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286a382a1b6e494208a245249185634446 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286a382a1b6e494208a245249185634446 2023-10-30 06:54:02,131 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/b749297d7ff94521925e4f1c56467914 2023-10-30 06:54:02,137 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/b749297d7ff94521925e4f1c56467914 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/b749297d7ff94521925e4f1c56467914 2023-10-30 06:54:02,142 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/b749297d7ff94521925e4f1c56467914, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 06:54:02,143 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 697de355dc3b2b8aa4f7ba137d4c52e6 in 431ms, sequenceid=9, compaction requested=false 2023-10-30 06:54:02,144 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:02,144 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:02,144 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:54:02,144 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:54:02,144 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,144 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 06:54:02,144 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 06:54:02,145 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,145 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:02,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:02,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:02,145 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,145 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:02,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:02,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:02,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 06:54:02,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c24b248[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:02,147 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 06:54:02,147 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,147 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,147 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 06:54:02,147 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 06:54:02,147 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:02,148 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,148 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:02,148 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,148 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 06:54:02,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,148 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:02,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:02,148 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 06:54:02,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:02,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:02,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:02,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:02,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:02,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 06:54:02,150 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 06:54:02,150 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:02,150 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:02,150 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,150 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:02,151 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,151 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:02,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:02,151 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:02,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:02,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:02,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:02,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,152 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:02,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,153 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:02,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,154 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:02,155 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:02,155 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:02,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:02,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:02,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:02,155 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:02,155 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,155 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,155 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,155 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,155 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:02,155 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:02,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:02,155 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,155 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:02,255 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:02,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:02,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:02,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:02,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,261 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:02,261 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:02,262 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 06:54:02,262 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 06:54:02,262 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,262 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,263 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:02,263 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:02,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:02,263 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:02,263 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:02,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:02,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,264 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,264 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 06:54:02,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:02,264 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 06:54:02,264 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:02,264 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 06:54:02,264 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:54:02,264 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:02,264 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:02,264 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. started... 2023-10-30 06:54:02,264 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 697de355dc3b2b8aa4f7ba137d4c52e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:54:02,677 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201168a381366e44bd4a39d726feff2e233 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201168a381366e44bd4a39d726feff2e233 2023-10-30 06:54:03,083 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/6562b027d7d140cf9423e11646670b89 2023-10-30 06:54:03,090 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/6562b027d7d140cf9423e11646670b89 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/6562b027d7d140cf9423e11646670b89 2023-10-30 06:54:03,096 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/6562b027d7d140cf9423e11646670b89, entries=1, sequenceid=13, filesize=5.0 K 2023-10-30 06:54:03,097 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 697de355dc3b2b8aa4f7ba137d4c52e6 in 833ms, sequenceid=13, compaction requested=true 2023-10-30 06:54:03,097 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:03,097 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:03,097 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:54:03,097 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:54:03,097 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,097 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 06:54:03,097 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 06:54:03,098 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:03,099 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:03,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:03,099 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,099 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:03,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:03,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:03,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 06:54:03,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d0bbb26[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:03,100 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 06:54:03,100 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,101 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,101 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 06:54:03,101 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,101 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:03,101 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 06:54:03,101 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:03,102 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,102 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 06:54:03,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:03,102 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:03,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:03,102 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 06:54:03,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:03,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 06:54:03,104 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 06:54:03,104 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:03,104 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:03,104 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,104 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:03,105 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,105 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:03,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,105 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:03,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:03,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:03,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,108 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,109 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:03,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,116 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,116 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:03,116 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:03,116 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:03,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:03,116 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:03,116 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:03,116 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,117 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,117 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,117 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:03,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:03,117 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:03,117 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:03,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:03,217 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:03,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:03,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:03,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:03,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,227 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:03,227 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:03,227 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 06:54:03,227 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 06:54:03,228 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,228 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,228 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:03,228 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:03,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:03,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,229 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:03,229 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:03,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:03,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,230 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,230 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 06:54:03,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:03,230 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 06:54:03,230 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:03,230 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 06:54:03,230 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:54:03,230 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:03,230 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:03,231 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. started... 2023-10-30 06:54:03,231 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 697de355dc3b2b8aa4f7ba137d4c52e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:54:03,585 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 06:54:03,656 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055c5d41e32d9543ea8870fee4b891fae5 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512055c5d41e32d9543ea8870fee4b891fae5 2023-10-30 06:54:04,063 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/bb5165e176244415b56d7a0b0d1e3b0c 2023-10-30 06:54:04,075 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/bb5165e176244415b56d7a0b0d1e3b0c as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/bb5165e176244415b56d7a0b0d1e3b0c 2023-10-30 06:54:04,082 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/bb5165e176244415b56d7a0b0d1e3b0c, entries=1, sequenceid=17, filesize=5.0 K 2023-10-30 06:54:04,083 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 697de355dc3b2b8aa4f7ba137d4c52e6 in 852ms, sequenceid=17, compaction requested=true 2023-10-30 06:54:04,083 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:04,083 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:04,083 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:54:04,083 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:54:04,083 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,083 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 06:54:04,083 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 06:54:04,086 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,086 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:04,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:04,086 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,087 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:04,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 06:54:04,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3be7bcd2[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:04,088 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 06:54:04,088 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,088 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,089 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 06:54:04,089 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 06:54:04,089 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:04,089 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,089 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:04,089 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 06:54:04,089 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,089 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:04,089 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 06:54:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:04,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 06:54:04,091 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 06:54:04,091 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:04,091 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:04,091 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,091 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:04,092 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,092 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:04,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,093 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:04,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,093 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:04,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,094 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:04,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,096 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,096 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,096 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:04,096 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:04,096 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:04,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:04,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:04,096 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:04,096 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 06:54:04,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:04,096 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,096 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:04,096 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,096 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:04,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:04,096 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:04,196 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:04,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:04,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:04,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:04,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,203 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:04,203 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:04,203 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 06:54:04,203 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 06:54:04,204 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,204 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,205 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:04,205 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:04,205 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:04,205 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:04,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,206 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,206 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 06:54:04,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:04,206 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 06:54:04,206 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:04,207 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 06:54:04,207 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:54:04,207 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:04,207 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:04,207 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. started... 2023-10-30 06:54:04,207 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 697de355dc3b2b8aa4f7ba137d4c52e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:54:04,622 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ab3ad701e23f40478fbd31460a3cf3b0 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228ab3ad701e23f40478fbd31460a3cf3b0 2023-10-30 06:54:05,028 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/f2d60ca92af94ad2ba7223b69bb8a3a4 2023-10-30 06:54:05,049 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3458169f to 127.0.0.1:50449 2023-10-30 06:54:05,050 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:54:05,050 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:54:05,050 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35f55c1a to 127.0.0.1:50449 2023-10-30 06:54:05,050 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:54:05,051 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:54:05,051 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7fa5f2ff to 127.0.0.1:50449 2023-10-30 06:54:05,051 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:54:05,051 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:54:05,051 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17dbddd4 to 127.0.0.1:50449 2023-10-30 06:54:05,051 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:54:05,051 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:54:05,052 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fd031d9 to 127.0.0.1:50449 2023-10-30 06:54:05,052 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:54:05,055 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/f2d60ca92af94ad2ba7223b69bb8a3a4 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/f2d60ca92af94ad2ba7223b69bb8a3a4 2023-10-30 06:54:05,059 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/f2d60ca92af94ad2ba7223b69bb8a3a4, entries=1, sequenceid=21, filesize=5.0 K 2023-10-30 06:54:05,060 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 697de355dc3b2b8aa4f7ba137d4c52e6 in 853ms, sequenceid=21, compaction requested=true 2023-10-30 06:54:05,060 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:05,060 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:05,060 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:54:05,060 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:54:05,060 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,060 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 06:54:05,060 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 06:54:05,153 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,153 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:05,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:05,154 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:05,154 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:05,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:05,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:05,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 06:54:05,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f5f560b[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:05,156 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 06:54:05,156 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,156 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,157 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 06:54:05,157 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 06:54:05,157 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:05,157 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,157 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:05,158 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 06:54:05,158 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:05,158 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,158 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 06:54:05,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:05,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:05,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:05,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:05,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:05,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:05,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 06:54:05,162 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 06:54:05,162 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:05,162 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:05,162 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,162 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:05,172 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,172 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:05,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,172 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:05,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:05,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:05,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:05,173 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:05,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:05,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,175 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:05,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,180 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,181 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:05,181 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:05,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:05,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 06:54:05,181 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:05,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:05,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:05,181 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:05,181 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:05,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:05,182 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,182 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:05,182 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,182 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:05,182 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,183 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,283 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:05,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:05,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:05,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:05,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,298 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:05,298 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:05,298 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 06:54:05,298 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 06:54:05,300 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,300 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,301 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,301 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:05,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:05,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:05,302 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:05,302 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:05,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:05,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,304 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,305 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 06:54:05,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:05,305 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 06:54:05,305 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:05,305 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 06:54:05,306 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:54:05,306 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:05,306 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:05,306 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. started... 2023-10-30 06:54:05,306 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 697de355dc3b2b8aa4f7ba137d4c52e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:54:05,731 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231cc61676d7613467283344a99509bbd22 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231cc61676d7613467283344a99509bbd22 2023-10-30 06:54:06,140 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/2cbcde1f6d7441e7b99cb1389596f8cd 2023-10-30 06:54:06,152 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/2cbcde1f6d7441e7b99cb1389596f8cd as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/2cbcde1f6d7441e7b99cb1389596f8cd 2023-10-30 06:54:06,158 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/2cbcde1f6d7441e7b99cb1389596f8cd, entries=1, sequenceid=25, filesize=5.0 K 2023-10-30 06:54:06,159 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 697de355dc3b2b8aa4f7ba137d4c52e6 in 853ms, sequenceid=25, compaction requested=true 2023-10-30 06:54:06,159 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:06,159 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:06,159 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:54:06,159 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:54:06,159 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,159 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 06:54:06,159 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 06:54:06,161 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,161 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:06,161 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,161 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:06,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:06,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:06,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:06,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 06:54:06,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3660155a[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:06,163 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 06:54:06,163 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,164 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,164 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 06:54:06,164 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 06:54:06,164 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:06,164 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,164 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:06,167 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 06:54:06,167 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,167 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:06,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:06,167 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 06:54:06,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:06,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:06,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:06,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:06,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:06,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 06:54:06,170 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 06:54:06,170 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:06,170 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:06,170 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,170 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:06,172 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,172 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:06,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:06,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,172 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:06,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:06,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:06,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:06,173 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,175 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,177 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,177 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:06,177 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,177 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,177 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:06,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:06,177 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:06,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:06,177 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:06,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:06,177 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,178 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,178 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,178 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:06,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:06,178 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:06,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:06,278 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:06,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:06,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:06,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:06,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,286 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:06,286 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:06,286 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 06:54:06,286 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 06:54:06,287 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,287 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,288 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,288 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:06,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:06,288 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:06,289 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:06,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:06,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,290 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,291 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 06:54:06,291 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:06,291 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 06:54:06,291 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:06,291 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 06:54:06,291 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:54:06,291 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:06,291 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:06,291 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. started... 2023-10-30 06:54:06,292 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 697de355dc3b2b8aa4f7ba137d4c52e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:54:06,718 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010151b4a5f6463d4d23bdafbd5f4b903622 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010151b4a5f6463d4d23bdafbd5f4b903622 2023-10-30 06:54:07,127 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/85786351872f4e3cbfb0e8a0894b275d 2023-10-30 06:54:07,141 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/85786351872f4e3cbfb0e8a0894b275d as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/85786351872f4e3cbfb0e8a0894b275d 2023-10-30 06:54:07,148 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/85786351872f4e3cbfb0e8a0894b275d, entries=1, sequenceid=29, filesize=5.0 K 2023-10-30 06:54:07,149 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 697de355dc3b2b8aa4f7ba137d4c52e6 in 857ms, sequenceid=29, compaction requested=true 2023-10-30 06:54:07,149 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:07,149 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:07,149 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:54:07,149 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:54:07,149 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,149 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 06:54:07,149 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 06:54:07,150 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,150 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:07,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:07,151 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,151 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:07,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:07,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:07,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:07,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 06:54:07,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66625a3b[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:07,153 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 06:54:07,153 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,153 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,154 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 06:54:07,154 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 06:54:07,154 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:07,154 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,154 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:07,154 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 06:54:07,154 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,154 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:07,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:07,155 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 06:54:07,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:07,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:07,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:07,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:07,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 06:54:07,158 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 06:54:07,158 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:07,158 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:07,158 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,158 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:07,159 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,159 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:07,159 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:07,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:07,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,159 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:07,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:07,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:07,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:07,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,160 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:07,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,161 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,161 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:07,161 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,161 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:07,161 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:07,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:07,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:07,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:07,161 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:07,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 06:54:07,162 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,162 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,162 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,162 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:07,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:07,162 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:07,162 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:07,262 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:07,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:07,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:07,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:07,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,276 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:07,276 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:07,276 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 06:54:07,276 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 06:54:07,276 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,276 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,277 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:07,277 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:07,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:07,277 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:07,277 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:07,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:07,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,278 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,278 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 06:54:07,278 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:07,278 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 06:54:07,278 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:07,278 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 06:54:07,278 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:54:07,278 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:07,279 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:07,279 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. started... 2023-10-30 06:54:07,279 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 697de355dc3b2b8aa4f7ba137d4c52e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:54:07,696 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103cdb9b091e2684497851da81e59d17cbc to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103cdb9b091e2684497851da81e59d17cbc 2023-10-30 06:54:08,104 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/a2223c5edcfe41d5aa5adedd568131c5 2023-10-30 06:54:08,116 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/a2223c5edcfe41d5aa5adedd568131c5 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/a2223c5edcfe41d5aa5adedd568131c5 2023-10-30 06:54:08,122 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/a2223c5edcfe41d5aa5adedd568131c5, entries=1, sequenceid=33, filesize=5.0 K 2023-10-30 06:54:08,124 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 697de355dc3b2b8aa4f7ba137d4c52e6 in 844ms, sequenceid=33, compaction requested=true 2023-10-30 06:54:08,124 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:08,124 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:08,124 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:54:08,124 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:54:08,124 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,124 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 06:54:08,124 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 06:54:08,126 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,126 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:08,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:08,126 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,126 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:08,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:08,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:08,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:08,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 06:54:08,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60657b09[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:08,129 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 06:54:08,129 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,130 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,130 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 06:54:08,131 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 06:54:08,131 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:08,131 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,131 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:08,132 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 06:54:08,132 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,132 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:08,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:08,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:08,132 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 06:54:08,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:08,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:08,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:08,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 06:54:08,135 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 06:54:08,135 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:08,135 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:08,135 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,135 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:08,141 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,141 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,141 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:08,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:08,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:08,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:08,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:08,142 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:08,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:08,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,144 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:08,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,149 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,149 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,149 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:08,149 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:08,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:08,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 06:54:08,149 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,149 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:08,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:08,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:08,149 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:08,149 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:08,149 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,150 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:08,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:08,150 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:08,150 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,250 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:08,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:08,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:08,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:08,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,261 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:08,261 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:08,261 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 06:54:08,261 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 06:54:08,262 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,262 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,263 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:08,263 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:08,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:08,263 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:08,263 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:08,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:08,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,264 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,264 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 06:54:08,264 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:08,264 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 06:54:08,264 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:08,264 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 06:54:08,265 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:54:08,265 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:08,265 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:08,265 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. started... 2023-10-30 06:54:08,265 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 697de355dc3b2b8aa4f7ba137d4c52e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:54:08,681 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079796aa10fe014e5d8c3a5796da862bfc to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509079796aa10fe014e5d8c3a5796da862bfc 2023-10-30 06:54:09,087 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/bf8eda19df3842a4aba4cfd2a67e6cda 2023-10-30 06:54:09,099 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/bf8eda19df3842a4aba4cfd2a67e6cda as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/bf8eda19df3842a4aba4cfd2a67e6cda 2023-10-30 06:54:09,105 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/bf8eda19df3842a4aba4cfd2a67e6cda, entries=1, sequenceid=37, filesize=5.0 K 2023-10-30 06:54:09,106 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 697de355dc3b2b8aa4f7ba137d4c52e6 in 841ms, sequenceid=37, compaction requested=true 2023-10-30 06:54:09,107 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:09,107 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:09,107 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:54:09,107 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:54:09,107 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,107 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 06:54:09,107 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 06:54:09,108 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,108 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:09,109 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,109 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:09,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 06:54:09,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@254f9600[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:09,111 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 06:54:09,111 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,111 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,112 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 06:54:09,112 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 06:54:09,112 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:09,112 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,112 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:09,112 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 06:54:09,112 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,112 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:09,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:09,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:09,112 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 06:54:09,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:09,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:09,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:09,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:09,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 06:54:09,114 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 06:54:09,114 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:09,114 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:09,114 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,114 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:09,115 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,115 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,115 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:09,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:09,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:09,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,116 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:09,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,117 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,118 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,118 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,118 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:09,118 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:09,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:09,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:09,118 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:09,118 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:09,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:09,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 06:54:09,118 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,119 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:09,119 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,119 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:09,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:09,119 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:09,119 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,219 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:09,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:09,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:09,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:09,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,230 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:09,230 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:09,230 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 06:54:09,230 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 06:54:09,231 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,231 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,232 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:09,232 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:09,233 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:09,233 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:09,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:09,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,234 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,235 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 06:54:09,235 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:09,235 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 06:54:09,235 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:09,235 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 06:54:09,235 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:54:09,235 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:09,235 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:09,235 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. started... 2023-10-30 06:54:09,236 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 697de355dc3b2b8aa4f7ba137d4c52e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:54:09,661 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120fd7d92bc5c784bfe9a95d7933a13d57b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120fd7d92bc5c784bfe9a95d7933a13d57b 2023-10-30 06:54:10,069 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/a98fe3ef531e44109a22d319d8e57751 2023-10-30 06:54:10,081 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/a98fe3ef531e44109a22d319d8e57751 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/a98fe3ef531e44109a22d319d8e57751 2023-10-30 06:54:10,088 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/a98fe3ef531e44109a22d319d8e57751, entries=1, sequenceid=41, filesize=5.0 K 2023-10-30 06:54:10,089 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 697de355dc3b2b8aa4f7ba137d4c52e6 in 853ms, sequenceid=41, compaction requested=true 2023-10-30 06:54:10,089 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:10,089 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:10,089 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:54:10,089 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:54:10,089 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,089 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 06:54:10,089 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 06:54:10,091 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,091 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:10,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:10,091 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,091 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:10,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:10,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:10,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:10,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 06:54:10,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13338d36[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:10,094 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 06:54:10,094 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,095 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,095 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 06:54:10,095 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 06:54:10,095 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:10,095 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,095 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:10,096 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 06:54:10,096 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,096 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:10,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:10,096 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 06:54:10,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:10,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:10,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 06:54:10,100 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 06:54:10,100 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:10,100 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:10,100 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,100 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:10,102 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,102 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:10,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,102 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:10,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:10,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:10,103 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:10,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:10,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:10,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,104 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:10,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,106 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,106 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,106 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:10,106 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,107 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:10,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:10,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:10,107 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:10,107 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:10,107 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,107 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 06:54:10,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 06:54:10,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:10,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:10,107 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:10,108 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:10,108 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:10,208 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:10,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:10,213 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:10,215 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 06:54:10,217 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 06:54:10,218 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:54:10,218 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649450218 2023-10-30 06:54:10,219 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 06:54:10,221 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-30 06:54:10,222 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 06:54:10,225 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x625d3140 to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:54:10,230 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@aad2999, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:54:10,231 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:11,082 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034aaf5de7ef704169949168f06a60f07a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601034aaf5de7ef704169949168f06a60f07a 2023-10-30 06:54:11,084 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 06:54:11,098 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:54:11,099 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:54:11,107 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:54:11,108 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:54:11,117 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/92500bef74d54329af93214eac4f2835 first=Optional[r3] last=Optional[r6] 2023-10-30 06:54:11,118 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/92500bef74d54329af93214eac4f2835}] 2023-10-30 06:54:11,124 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/92500bef74d54329af93214eac4f2835 for inclusion in 697de355dc3b2b8aa4f7ba137d4c52e6/family1 2023-10-30 06:54:11,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 06:54:11,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:54:11,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:11,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/92500bef74d54329af93214eac4f2835 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__aqt12ei5bvkik0djb48999ahij6aba0cd33smpbigtbc0ffcd8bgoi2jrdq16cru/family1/92500bef74d54329af93214eac4f2835 2023-10-30 06:54:11,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__aqt12ei5bvkik0djb48999ahij6aba0cd33smpbigtbc0ffcd8bgoi2jrdq16cru/family1/92500bef74d54329af93214eac4f2835 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/8f01e0c940544cf0aeaf6dd4a8edd53e_SeqId_44_ 2023-10-30 06:54:11,133 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__aqt12ei5bvkik0djb48999ahij6aba0cd33smpbigtbc0ffcd8bgoi2jrdq16cru/family1/92500bef74d54329af93214eac4f2835 into 697de355dc3b2b8aa4f7ba137d4c52e6/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/8f01e0c940544cf0aeaf6dd4a8edd53e_SeqId_44_ - updating store file list. 2023-10-30 06:54:11,138 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/8f01e0c940544cf0aeaf6dd4a8edd53e_SeqId_44_ into 697de355dc3b2b8aa4f7ba137d4c52e6/family1 2023-10-30 06:54:11,138 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__aqt12ei5bvkik0djb48999ahij6aba0cd33smpbigtbc0ffcd8bgoi2jrdq16cru/family1/92500bef74d54329af93214eac4f2835 into 697de355dc3b2b8aa4f7ba137d4c52e6/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/8f01e0c940544cf0aeaf6dd4a8edd53e_SeqId_44_) 2023-10-30 06:54:11,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__aqt12ei5bvkik0djb48999ahij6aba0cd33smpbigtbc0ffcd8bgoi2jrdq16cru/family1/92500bef74d54329af93214eac4f2835 2023-10-30 06:54:11,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 06:54:11,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 06:54:11,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(1912): 697de355dc3b2b8aa4f7ba137d4c52e6/family1 is initiating minor compaction 2023-10-30 06:54:11,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3be03490; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:54:11,145 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 697de355dc3b2b8aa4f7ba137d4c52e6/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:11,145 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/b749297d7ff94521925e4f1c56467914, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/6562b027d7d140cf9423e11646670b89, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/bb5165e176244415b56d7a0b0d1e3b0c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/f2d60ca92af94ad2ba7223b69bb8a3a4, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/2cbcde1f6d7441e7b99cb1389596f8cd, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/85786351872f4e3cbfb0e8a0894b275d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/a2223c5edcfe41d5aa5adedd568131c5, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/bf8eda19df3842a4aba4cfd2a67e6cda, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/a98fe3ef531e44109a22d319d8e57751, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/8f01e0c940544cf0aeaf6dd4a8edd53e_SeqId_44_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp, totalSize=50.3 K 2023-10-30 06:54:11,146 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting b749297d7ff94521925e4f1c56467914, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 06:54:11,146 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 6562b027d7d140cf9423e11646670b89, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 06:54:11,146 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting bb5165e176244415b56d7a0b0d1e3b0c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 06:54:11,146 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting f2d60ca92af94ad2ba7223b69bb8a3a4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 06:54:11,146 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 2cbcde1f6d7441e7b99cb1389596f8cd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 06:54:11,146 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 85786351872f4e3cbfb0e8a0894b275d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 06:54:11,146 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting a2223c5edcfe41d5aa5adedd568131c5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 06:54:11,146 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting bf8eda19df3842a4aba4cfd2a67e6cda, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 06:54:11,146 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting a98fe3ef531e44109a22d319d8e57751, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 06:54:11,147 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 8f01e0c940544cf0aeaf6dd4a8edd53e_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 06:54:11,148 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 06:54:11,149 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:11,151 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228ab3ad701e23f40478fbd31460a3cf3b0 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228ab3ad701e23f40478fbd31460a3cf3b0 2023-10-30 06:54:11,152 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231cc61676d7613467283344a99509bbd22 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231cc61676d7613467283344a99509bbd22 2023-10-30 06:54:11,154 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010151b4a5f6463d4d23bdafbd5f4b903622 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010151b4a5f6463d4d23bdafbd5f4b903622 2023-10-30 06:54:11,156 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103cdb9b091e2684497851da81e59d17cbc to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103cdb9b091e2684497851da81e59d17cbc 2023-10-30 06:54:11,156 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-10-30 06:54:11,156 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 06:54:11,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:11,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:11,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:11,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:11,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:11,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:11,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:11,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:11,190 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): 697de355dc3b2b8aa4f7ba137d4c52e6#family1#compaction#72 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:54:12,012 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/89b81824e2ef4166ad2497cac7a70e94 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/89b81824e2ef4166ad2497cac7a70e94 2023-10-30 06:54:12,017 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 697de355dc3b2b8aa4f7ba137d4c52e6/family1 of 697de355dc3b2b8aa4f7ba137d4c52e6 into 89b81824e2ef4166ad2497cac7a70e94(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:54:12,017 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:12,017 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698648851145; duration=0sec 2023-10-30 06:54:12,017 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:54:12,018 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d281bd1beaba491ba7ee4a2793556a4c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205d281bd1beaba491ba7ee4a2793556a4c 2023-10-30 06:54:12,019 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 06:54:12,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/b749297d7ff94521925e4f1c56467914, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/6562b027d7d140cf9423e11646670b89, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/bb5165e176244415b56d7a0b0d1e3b0c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/f2d60ca92af94ad2ba7223b69bb8a3a4, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/2cbcde1f6d7441e7b99cb1389596f8cd, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/85786351872f4e3cbfb0e8a0894b275d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/a2223c5edcfe41d5aa5adedd568131c5, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/bf8eda19df3842a4aba4cfd2a67e6cda, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/a98fe3ef531e44109a22d319d8e57751, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/8f01e0c940544cf0aeaf6dd4a8edd53e_SeqId_44_] to archive 2023-10-30 06:54:12,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:12,050 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d9bd51618a554e60be19b3120e266b75 first=Optional[r00] last=Optional[r2] 2023-10-30 06:54:12,051 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d9bd51618a554e60be19b3120e266b75}] 2023-10-30 06:54:12,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/b749297d7ff94521925e4f1c56467914 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/b749297d7ff94521925e4f1c56467914 2023-10-30 06:54:12,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/6562b027d7d140cf9423e11646670b89 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/6562b027d7d140cf9423e11646670b89 2023-10-30 06:54:12,053 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d9bd51618a554e60be19b3120e266b75 for inclusion in 697de355dc3b2b8aa4f7ba137d4c52e6/family1 2023-10-30 06:54:12,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/bb5165e176244415b56d7a0b0d1e3b0c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/bb5165e176244415b56d7a0b0d1e3b0c 2023-10-30 06:54:12,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/f2d60ca92af94ad2ba7223b69bb8a3a4 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/f2d60ca92af94ad2ba7223b69bb8a3a4 2023-10-30 06:54:12,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-30 06:54:12,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:54:12,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:12,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/2cbcde1f6d7441e7b99cb1389596f8cd to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/2cbcde1f6d7441e7b99cb1389596f8cd 2023-10-30 06:54:12,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d9bd51618a554e60be19b3120e266b75 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6q1ec675gc335g2cmf0uk2it3o7tn39f5ft779hudlhjf622an5mrru42os0j3dl/family1/d9bd51618a554e60be19b3120e266b75 2023-10-30 06:54:12,057 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/85786351872f4e3cbfb0e8a0894b275d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/85786351872f4e3cbfb0e8a0894b275d 2023-10-30 06:54:12,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/a2223c5edcfe41d5aa5adedd568131c5 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/a2223c5edcfe41d5aa5adedd568131c5 2023-10-30 06:54:12,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6q1ec675gc335g2cmf0uk2it3o7tn39f5ft779hudlhjf622an5mrru42os0j3dl/family1/d9bd51618a554e60be19b3120e266b75 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/455c7acef0084ce69a7ecd1e9b51572f_SeqId_47_ 2023-10-30 06:54:12,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/bf8eda19df3842a4aba4cfd2a67e6cda to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/bf8eda19df3842a4aba4cfd2a67e6cda 2023-10-30 06:54:12,059 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6q1ec675gc335g2cmf0uk2it3o7tn39f5ft779hudlhjf622an5mrru42os0j3dl/family1/d9bd51618a554e60be19b3120e266b75 into 697de355dc3b2b8aa4f7ba137d4c52e6/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/455c7acef0084ce69a7ecd1e9b51572f_SeqId_47_ - updating store file list. 2023-10-30 06:54:12,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/a98fe3ef531e44109a22d319d8e57751 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/a98fe3ef531e44109a22d319d8e57751 2023-10-30 06:54:12,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/8f01e0c940544cf0aeaf6dd4a8edd53e_SeqId_44_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/8f01e0c940544cf0aeaf6dd4a8edd53e_SeqId_44_ 2023-10-30 06:54:12,063 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/455c7acef0084ce69a7ecd1e9b51572f_SeqId_47_ into 697de355dc3b2b8aa4f7ba137d4c52e6/family1 2023-10-30 06:54:12,063 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6q1ec675gc335g2cmf0uk2it3o7tn39f5ft779hudlhjf622an5mrru42os0j3dl/family1/d9bd51618a554e60be19b3120e266b75 into 697de355dc3b2b8aa4f7ba137d4c52e6/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/455c7acef0084ce69a7ecd1e9b51572f_SeqId_47_) 2023-10-30 06:54:12,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6q1ec675gc335g2cmf0uk2it3o7tn39f5ft779hudlhjf622an5mrru42os0j3dl/family1/d9bd51618a554e60be19b3120e266b75 2023-10-30 06:54:12,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 06:54:12,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 06:54:12,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(1912): 697de355dc3b2b8aa4f7ba137d4c52e6/family1 is initiating minor compaction (all files) 2023-10-30 06:54:12,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3710a29a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:54:12,065 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 697de355dc3b2b8aa4f7ba137d4c52e6/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:12,065 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/e04e57ee3d74499589ce1278cd50db66, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/89b81824e2ef4166ad2497cac7a70e94, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/455c7acef0084ce69a7ecd1e9b51572f_SeqId_47_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp, totalSize=388.1 K 2023-10-30 06:54:12,065 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting e04e57ee3d74499589ce1278cd50db66, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878849956 2023-10-30 06:54:12,066 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 89b81824e2ef4166ad2497cac7a70e94, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621249956 2023-10-30 06:54:12,066 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 455c7acef0084ce69a7ecd1e9b51572f_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878849956 2023-10-30 06:54:12,066 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 06:54:12,067 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:12,068 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130bdb55056424648a682d0ce6697b43276 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130bdb55056424648a682d0ce6697b43276 2023-10-30 06:54:12,069 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201168a381366e44bd4a39d726feff2e233 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201168a381366e44bd4a39d726feff2e233 2023-10-30 06:54:12,070 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512055c5d41e32d9543ea8870fee4b891fae5 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512055c5d41e32d9543ea8870fee4b891fae5 2023-10-30 06:54:12,071 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-10-30 06:54:12,071 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 06:54:12,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:12,071 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 06:54:12,071 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:54:12,072 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 06:54:12,074 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8580 sec 2023-10-30 06:54:12,085 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): 697de355dc3b2b8aa4f7ba137d4c52e6#family1#compaction#73 average throughput is 25.66 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:54:12,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 06:54:12,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:12,553 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-30 06:54:12,556 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-10-30 06:54:12,556 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-30 06:54:12,560 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-10-30 06:54:12,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=697de355dc3b2b8aa4f7ba137d4c52e6, REOPEN/MOVE}] 2023-10-30 06:54:12,565 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=697de355dc3b2b8aa4f7ba137d4c52e6, REOPEN/MOVE 2023-10-30 06:54:12,567 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=697de355dc3b2b8aa4f7ba137d4c52e6, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:12,567 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698648852566"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648852566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648852566"}]},"ts":"1698648852566"} 2023-10-30 06:54:12,569 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 697de355dc3b2b8aa4f7ba137d4c52e6, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:12,721 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:12,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:12,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 697de355dc3b2b8aa4f7ba137d4c52e6, disabling compactions & flushes 2023-10-30 06:54:12,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:12,913 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/.tmp/family1/cf328dd453d04ee2a1fe7f0e96987a2c as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/cf328dd453d04ee2a1fe7f0e96987a2c 2023-10-30 06:54:12,918 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 697de355dc3b2b8aa4f7ba137d4c52e6/family1 of 697de355dc3b2b8aa4f7ba137d4c52e6 into cf328dd453d04ee2a1fe7f0e96987a2c(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:54:12,918 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:12,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:12,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:12,919 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1698648852065; duration=0sec 2023-10-30 06:54:12,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. after waiting 0 ms 2023-10-30 06:54:12,919 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:54:12,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:12,923 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/e04e57ee3d74499589ce1278cd50db66, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/89b81824e2ef4166ad2497cac7a70e94, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/455c7acef0084ce69a7ecd1e9b51572f_SeqId_47_] to archive 2023-10-30 06:54:12,924 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:12,926 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/e04e57ee3d74499589ce1278cd50db66 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/e04e57ee3d74499589ce1278cd50db66 2023-10-30 06:54:12,927 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/89b81824e2ef4166ad2497cac7a70e94 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/89b81824e2ef4166ad2497cac7a70e94 2023-10-30 06:54:12,929 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/455c7acef0084ce69a7ecd1e9b51572f_SeqId_47_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/455c7acef0084ce69a7ecd1e9b51572f_SeqId_47_ 2023-10-30 06:54:12,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-30 06:54:12,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:12,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:12,937 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 697de355dc3b2b8aa4f7ba137d4c52e6 to self. 2023-10-30 06:54:12,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:12,939 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=697de355dc3b2b8aa4f7ba137d4c52e6, regionState=CLOSED 2023-10-30 06:54:12,939 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698648852939"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648852939"}]},"ts":"1698648852939"} 2023-10-30 06:54:12,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-10-30 06:54:12,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 697de355dc3b2b8aa4f7ba137d4c52e6, server=jenkins-hbase20.apache.org,40611,1698648765457 in 372 msec 2023-10-30 06:54:12,943 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=697de355dc3b2b8aa4f7ba137d4c52e6, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=true 2023-10-30 06:54:13,094 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=697de355dc3b2b8aa4f7ba137d4c52e6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:13,094 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698648853094"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648853094"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648853094"}]},"ts":"1698648853094"} 2023-10-30 06:54:13,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 697de355dc3b2b8aa4f7ba137d4c52e6, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:13,248 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:13,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:13,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 697de355dc3b2b8aa4f7ba137d4c52e6, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:54:13,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:13,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:13,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:13,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:13,258 INFO [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:13,260 DEBUG [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1 2023-10-30 06:54:13,260 DEBUG [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1 2023-10-30 06:54:13,261 INFO [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 697de355dc3b2b8aa4f7ba137d4c52e6 columnFamilyName family1 2023-10-30 06:54:13,268 DEBUG [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/cf328dd453d04ee2a1fe7f0e96987a2c 2023-10-30 06:54:13,268 INFO [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] regionserver.HStore(310): Store=697de355dc3b2b8aa4f7ba137d4c52e6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:13,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:13,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:13,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:13,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 697de355dc3b2b8aa4f7ba137d4c52e6; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67032354, jitterRate=-0.0011400878429412842}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:54:13,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:13,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6., pid=63, masterSystemTime=1698648853248 2023-10-30 06:54:13,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:13,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:13,278 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=697de355dc3b2b8aa4f7ba137d4c52e6, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:13,279 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698648853278"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648853278"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648853278"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648853278"}]},"ts":"1698648853278"} 2023-10-30 06:54:13,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-10-30 06:54:13,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 697de355dc3b2b8aa4f7ba137d4c52e6, server=jenkins-hbase20.apache.org,40611,1698648765457 in 184 msec 2023-10-30 06:54:13,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-10-30 06:54:13,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=697de355dc3b2b8aa4f7ba137d4c52e6, REOPEN/MOVE in 718 msec 2023-10-30 06:54:13,287 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-30 06:54:13,287 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 725 msec 2023-10-30 06:54:13,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1470 sec 2023-10-30 06:54:13,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-10-30 06:54:13,292 INFO [Listener at localhost/40811] compactions.TestMobCompactor(278): alter status finished 2023-10-30 06:54:13,293 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:13,294 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 06:54:13,294 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 06:54:13,295 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:54:13,295 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649453295 2023-10-30 06:54:13,296 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 06:54:13,296 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-30 06:54:13,296 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 06:54:13,298 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x355e1f6f to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:54:13,323 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d0eea31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:54:13,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:13,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:13,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:13,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:13,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:14,161 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280a1ff5677217468eba10bb3e7f4d0191 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511280a1ff5677217468eba10bb3e7f4d0191 2023-10-30 06:54:14,162 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 06:54:14,173 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:54:14,174 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:54:14,181 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:54:14,183 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:54:14,193 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7850c37e8b4f4a559cfb31a87fa8d9e9 first=Optional[r05] last=Optional[r8] 2023-10-30 06:54:14,193 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=51 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7850c37e8b4f4a559cfb31a87fa8d9e9}] 2023-10-30 06:54:14,198 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7850c37e8b4f4a559cfb31a87fa8d9e9 for inclusion in 697de355dc3b2b8aa4f7ba137d4c52e6/family1 2023-10-30 06:54:14,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-30 06:54:14,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:54:14,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:14,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7850c37e8b4f4a559cfb31a87fa8d9e9 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__lpnheoq5lil4b5qmfmj8r8h8j8qd3gf0eu09v5bas17imi1glvfaq67s4ku9snhc/family1/7850c37e8b4f4a559cfb31a87fa8d9e9 2023-10-30 06:54:14,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__lpnheoq5lil4b5qmfmj8r8h8j8qd3gf0eu09v5bas17imi1glvfaq67s4ku9snhc/family1/7850c37e8b4f4a559cfb31a87fa8d9e9 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/8fe09c92d1f14f9b9b722c05e5d34497_SeqId_53_ 2023-10-30 06:54:14,206 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__lpnheoq5lil4b5qmfmj8r8h8j8qd3gf0eu09v5bas17imi1glvfaq67s4ku9snhc/family1/7850c37e8b4f4a559cfb31a87fa8d9e9 into 697de355dc3b2b8aa4f7ba137d4c52e6/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/8fe09c92d1f14f9b9b722c05e5d34497_SeqId_53_ - updating store file list. 2023-10-30 06:54:14,210 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/8fe09c92d1f14f9b9b722c05e5d34497_SeqId_53_ into 697de355dc3b2b8aa4f7ba137d4c52e6/family1 2023-10-30 06:54:14,210 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__lpnheoq5lil4b5qmfmj8r8h8j8qd3gf0eu09v5bas17imi1glvfaq67s4ku9snhc/family1/7850c37e8b4f4a559cfb31a87fa8d9e9 into 697de355dc3b2b8aa4f7ba137d4c52e6/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/8fe09c92d1f14f9b9b722c05e5d34497_SeqId_53_) 2023-10-30 06:54:14,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__lpnheoq5lil4b5qmfmj8r8h8j8qd3gf0eu09v5bas17imi1glvfaq67s4ku9snhc/family1/7850c37e8b4f4a559cfb31a87fa8d9e9 2023-10-30 06:54:14,213 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 06:54:14,214 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:14,216 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120fd7d92bc5c784bfe9a95d7933a13d57b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120fd7d92bc5c784bfe9a95d7933a13d57b 2023-10-30 06:54:14,218 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286a382a1b6e494208a245249185634446 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511286a382a1b6e494208a245249185634446 2023-10-30 06:54:14,218 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-10-30 06:54:14,218 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 06:54:14,218 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:14,218 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:14,218 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:14,219 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 06:54:14,219 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:54:14,220 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 06:54:14,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 927 msec 2023-10-30 06:54:14,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-10-30 06:54:14,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:14,684 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-10-30 06:54:14,688 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-30 06:54:14,688 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-10-30 06:54:14,693 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-10-30 06:54:14,698 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=697de355dc3b2b8aa4f7ba137d4c52e6, REOPEN/MOVE}] 2023-10-30 06:54:14,699 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=697de355dc3b2b8aa4f7ba137d4c52e6, REOPEN/MOVE 2023-10-30 06:54:14,701 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=697de355dc3b2b8aa4f7ba137d4c52e6, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:14,701 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698648854701"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648854701"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648854701"}]},"ts":"1698648854701"} 2023-10-30 06:54:14,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 697de355dc3b2b8aa4f7ba137d4c52e6, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:14,856 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:14,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:14,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 697de355dc3b2b8aa4f7ba137d4c52e6, disabling compactions & flushes 2023-10-30 06:54:14,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:14,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:14,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. after waiting 0 ms 2023-10-30 06:54:14,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:14,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-30 06:54:14,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:14,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:14,873 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 697de355dc3b2b8aa4f7ba137d4c52e6 to self. 2023-10-30 06:54:14,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:14,876 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=697de355dc3b2b8aa4f7ba137d4c52e6, regionState=CLOSED 2023-10-30 06:54:14,876 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698648854876"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648854876"}]},"ts":"1698648854876"} 2023-10-30 06:54:14,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-10-30 06:54:14,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 697de355dc3b2b8aa4f7ba137d4c52e6, server=jenkins-hbase20.apache.org,40611,1698648765457 in 173 msec 2023-10-30 06:54:14,880 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=697de355dc3b2b8aa4f7ba137d4c52e6, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=true 2023-10-30 06:54:15,031 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=697de355dc3b2b8aa4f7ba137d4c52e6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:15,031 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698648855031"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648855031"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648855031"}]},"ts":"1698648855031"} 2023-10-30 06:54:15,036 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 697de355dc3b2b8aa4f7ba137d4c52e6, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:15,189 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:15,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:15,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 697de355dc3b2b8aa4f7ba137d4c52e6, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:54:15,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:15,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:15,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:15,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:15,200 INFO [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:15,201 DEBUG [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1 2023-10-30 06:54:15,202 DEBUG [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1 2023-10-30 06:54:15,202 INFO [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 697de355dc3b2b8aa4f7ba137d4c52e6 columnFamilyName family1 2023-10-30 06:54:15,210 DEBUG [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/8fe09c92d1f14f9b9b722c05e5d34497_SeqId_53_ 2023-10-30 06:54:15,214 DEBUG [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/family1/cf328dd453d04ee2a1fe7f0e96987a2c 2023-10-30 06:54:15,215 INFO [StoreOpener-697de355dc3b2b8aa4f7ba137d4c52e6-1] regionserver.HStore(310): Store=697de355dc3b2b8aa4f7ba137d4c52e6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:15,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:15,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:15,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:54:15,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 697de355dc3b2b8aa4f7ba137d4c52e6; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61877406, jitterRate=-0.07795479893684387}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:54:15,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:54:15,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6., pid=69, masterSystemTime=1698648855189 2023-10-30 06:54:15,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:15,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:54:15,224 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=697de355dc3b2b8aa4f7ba137d4c52e6, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:15,224 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698648855224"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648855224"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648855224"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648855224"}]},"ts":"1698648855224"} 2023-10-30 06:54:15,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-30 06:54:15,227 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 697de355dc3b2b8aa4f7ba137d4c52e6, server=jenkins-hbase20.apache.org,40611,1698648765457 in 189 msec 2023-10-30 06:54:15,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-30 06:54:15,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=697de355dc3b2b8aa4f7ba137d4c52e6, REOPEN/MOVE in 529 msec 2023-10-30 06:54:15,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-10-30 06:54:15,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 535 msec 2023-10-30 06:54:15,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 959 msec 2023-10-30 06:54:15,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-10-30 06:54:15,233 INFO [Listener at localhost/40811] compactions.TestMobCompactor(278): alter status finished 2023-10-30 06:54:15,233 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 06:54:15,234 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 06:54:15,235 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 06:54:15,236 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:54:15,236 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649455236 2023-10-30 06:54:15,236 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 06:54:15,237 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-30 06:54:15,237 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 06:54:15,239 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x01405f67 to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:54:15,242 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e26815a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:54:15,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:15,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:15,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:15,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:15,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:15,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:15,243 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:15,243 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 06:54:15,243 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 06:54:15,243 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:54:15,243 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 06:54:15,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 9 msec 2023-10-30 06:54:15,293 INFO [Listener at localhost/40811] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=242 (was 247), OpenFileDescriptor=615 (was 622), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=177 (was 184), ProcessCount=167 (was 167), AvailableMemoryMB=2379 (was 2457) 2023-10-30 06:54:15,303 INFO [Listener at localhost/40811] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=242, OpenFileDescriptor=615, MaxFileDescriptor=60000, SystemLoadAverage=177, ProcessCount=167, AvailableMemoryMB=2379 2023-10-30 06:54:15,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 06:54:15,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-10-30 06:54:15,308 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 06:54:15,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-10-30 06:54:15,309 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 06:54:15,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 06:54:15,310 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5 2023-10-30 06:54:15,310 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5 empty. 2023-10-30 06:54:15,310 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5 2023-10-30 06:54:15,310 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-10-30 06:54:15,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 06:54:15,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 06:54:15,722 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-10-30 06:54:15,726 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => b0877a1ba3ffb8986d6e724881c8dce5, NAME => 'testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:54:15,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 06:54:16,137 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:16,137 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing b0877a1ba3ffb8986d6e724881c8dce5, disabling compactions & flushes 2023-10-30 06:54:16,137 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. 2023-10-30 06:54:16,137 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. 2023-10-30 06:54:16,137 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. after waiting 0 ms 2023-10-30 06:54:16,137 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. 2023-10-30 06:54:16,137 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. 2023-10-30 06:54:16,138 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for b0877a1ba3ffb8986d6e724881c8dce5: 2023-10-30 06:54:16,140 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 06:54:16,141 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698648856141"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648856141"}]},"ts":"1698648856141"} 2023-10-30 06:54:16,143 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 06:54:16,144 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 06:54:16,144 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648856144"}]},"ts":"1698648856144"} 2023-10-30 06:54:16,145 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-10-30 06:54:16,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=b0877a1ba3ffb8986d6e724881c8dce5, ASSIGN}] 2023-10-30 06:54:16,149 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=b0877a1ba3ffb8986d6e724881c8dce5, ASSIGN 2023-10-30 06:54:16,150 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=b0877a1ba3ffb8986d6e724881c8dce5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:54:16,301 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=b0877a1ba3ffb8986d6e724881c8dce5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:16,301 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698648856301"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648856301"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648856301"}]},"ts":"1698648856301"} 2023-10-30 06:54:16,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure b0877a1ba3ffb8986d6e724881c8dce5, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:16,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 06:54:16,454 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:16,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. 2023-10-30 06:54:16,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b0877a1ba3ffb8986d6e724881c8dce5, NAME => 'testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:54:16,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-10-30 06:54:16,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-10-30 06:54:16,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction b0877a1ba3ffb8986d6e724881c8dce5 2023-10-30 06:54:16,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:16,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b0877a1ba3ffb8986d6e724881c8dce5 2023-10-30 06:54:16,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b0877a1ba3ffb8986d6e724881c8dce5 2023-10-30 06:54:16,468 INFO [StoreOpener-b0877a1ba3ffb8986d6e724881c8dce5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b0877a1ba3ffb8986d6e724881c8dce5 2023-10-30 06:54:16,471 DEBUG [StoreOpener-b0877a1ba3ffb8986d6e724881c8dce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1 2023-10-30 06:54:16,471 DEBUG [StoreOpener-b0877a1ba3ffb8986d6e724881c8dce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1 2023-10-30 06:54:16,471 INFO [StoreOpener-b0877a1ba3ffb8986d6e724881c8dce5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0877a1ba3ffb8986d6e724881c8dce5 columnFamilyName f1 2023-10-30 06:54:16,473 INFO [StoreOpener-b0877a1ba3ffb8986d6e724881c8dce5-1] regionserver.HStore(310): Store=b0877a1ba3ffb8986d6e724881c8dce5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:16,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5 2023-10-30 06:54:16,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5 2023-10-30 06:54:16,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b0877a1ba3ffb8986d6e724881c8dce5 2023-10-30 06:54:16,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:54:16,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b0877a1ba3ffb8986d6e724881c8dce5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71928909, jitterRate=0.07182426750659943}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:54:16,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b0877a1ba3ffb8986d6e724881c8dce5: 2023-10-30 06:54:16,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5., pid=73, masterSystemTime=1698648856454 2023-10-30 06:54:16,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. 2023-10-30 06:54:16,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. 2023-10-30 06:54:16,486 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=b0877a1ba3ffb8986d6e724881c8dce5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:16,486 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698648856486"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648856486"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648856486"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648856486"}]},"ts":"1698648856486"} 2023-10-30 06:54:16,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-10-30 06:54:16,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure b0877a1ba3ffb8986d6e724881c8dce5, server=jenkins-hbase20.apache.org,40611,1698648765457 in 185 msec 2023-10-30 06:54:16,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-30 06:54:16,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=b0877a1ba3ffb8986d6e724881c8dce5, ASSIGN in 341 msec 2023-10-30 06:54:16,491 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 06:54:16,491 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648856491"}]},"ts":"1698648856491"} 2023-10-30 06:54:16,492 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-10-30 06:54:16,494 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 06:54:16,495 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1880 sec 2023-10-30 06:54:16,911 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-10-30 06:54:17,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 06:54:17,421 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-10-30 06:54:17,421 DEBUG [Listener at localhost/40811] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-10-30 06:54:17,426 INFO [Listener at localhost/40811] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-30 06:54:17,433 INFO [Listener at localhost/40811] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-10-30 06:54:17,434 INFO [Listener at localhost/40811] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-30 06:54:17,434 INFO [Listener at localhost/40811] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-10-30 06:54:17,438 INFO [Listener at localhost/40811] regionserver.HRegion(2745): Flushing b0877a1ba3ffb8986d6e724881c8dce5 1/1 column families, dataSize=37 B heapSize=368 B 2023-10-30 06:54:17,859 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030f0af0e418fcb493aa90f5b06e4a45516 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231030f0af0e418fcb493aa90f5b06e4a45516 2023-10-30 06:54:18,267 INFO [Listener at localhost/40811] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/.tmp/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c 2023-10-30 06:54:18,279 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/.tmp/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c 2023-10-30 06:54:18,284 INFO [Listener at localhost/40811] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c, entries=1, sequenceid=5, filesize=4.9 K 2023-10-30 06:54:18,285 INFO [Listener at localhost/40811] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for b0877a1ba3ffb8986d6e724881c8dce5 in 847ms, sequenceid=5, compaction requested=false 2023-10-30 06:54:18,286 DEBUG [Listener at localhost/40811] regionserver.HRegion(2446): Flush status journal for b0877a1ba3ffb8986d6e724881c8dce5: 2023-10-30 06:54:18,287 INFO [Listener at localhost/40811] regionserver.HRegion(2745): Flushing b0877a1ba3ffb8986d6e724881c8dce5 1/1 column families, dataSize=37 B heapSize=368 B 2023-10-30 06:54:18,479 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 06:54:18,703 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310301c0c110e53c344818d988bf03d2240ca to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310301c0c110e53c344818d988bf03d2240ca 2023-10-30 06:54:19,111 INFO [Listener at localhost/40811] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/.tmp/f1/39f1477e282847e2b1cab792fa16f0e1 2023-10-30 06:54:19,117 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/.tmp/f1/39f1477e282847e2b1cab792fa16f0e1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1 2023-10-30 06:54:19,124 INFO [Listener at localhost/40811] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1, entries=1, sequenceid=9, filesize=4.9 K 2023-10-30 06:54:19,125 INFO [Listener at localhost/40811] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for b0877a1ba3ffb8986d6e724881c8dce5 in 838ms, sequenceid=9, compaction requested=false 2023-10-30 06:54:19,125 DEBUG [Listener at localhost/40811] regionserver.HRegion(2446): Flush status journal for b0877a1ba3ffb8986d6e724881c8dce5: 2023-10-30 06:54:19,127 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-10-30 06:54:19,128 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-30 06:54:19,129 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-30 06:54:19,130 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649459130 2023-10-30 06:54:19,130 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:54:19,130 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 06:54:19,131 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-10-30 06:54:19,131 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-10-30 06:54:19,133 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x2e456136 to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:54:19,137 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@743309f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:54:19,137 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='testGetAfterCompaction' and column='f1' 2023-10-30 06:54:19,179 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,179 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,230 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,230 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,282 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,282 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,334 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,334 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,386 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,386 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,438 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,438 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,489 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,490 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,542 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,542 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,594 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,594 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,646 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,646 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,698 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,698 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,750 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,750 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,801 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,802 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,852 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,853 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,904 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,904 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,955 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,955 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:19,970 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030a9f8efde892645728acce336d027909c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231030a9f8efde892645728acce336d027909c 2023-10-30 06:54:19,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testGetAfterCompaction' column='f1' 2023-10-30 06:54:19,986 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:54:19,987 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:54:19,993 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:54:19,994 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:54:20,004 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/f1/c6fd939f2a0143a599e031f985f18807 first=Optional[r1] last=Optional[r2] 2023-10-30 06:54:20,004 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{f1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/f1/c6fd939f2a0143a599e031f985f18807}] 2023-10-30 06:54:20,006 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,006 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,009 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/f1/c6fd939f2a0143a599e031f985f18807 for inclusion in b0877a1ba3ffb8986d6e724881c8dce5/f1 2023-10-30 06:54:20,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-10-30 06:54:20,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:54:20,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for b0877a1ba3ffb8986d6e724881c8dce5: 2023-10-30 06:54:20,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/f1/c6fd939f2a0143a599e031f985f18807 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testGetAfterCompaction__co7j6fot1mn32er4dv6dgv0eo1osv6uuc361knoclsvedadul9p70nmotfco25uu/f1/c6fd939f2a0143a599e031f985f18807 2023-10-30 06:54:20,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testGetAfterCompaction__co7j6fot1mn32er4dv6dgv0eo1osv6uuc361knoclsvedadul9p70nmotfco25uu/f1/c6fd939f2a0143a599e031f985f18807 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_ 2023-10-30 06:54:20,017 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testGetAfterCompaction__co7j6fot1mn32er4dv6dgv0eo1osv6uuc361knoclsvedadul9p70nmotfco25uu/f1/c6fd939f2a0143a599e031f985f18807 into b0877a1ba3ffb8986d6e724881c8dce5/f1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_ - updating store file list. 2023-10-30 06:54:20,021 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_ into b0877a1ba3ffb8986d6e724881c8dce5/f1 2023-10-30 06:54:20,022 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testGetAfterCompaction__co7j6fot1mn32er4dv6dgv0eo1osv6uuc361knoclsvedadul9p70nmotfco25uu/f1/c6fd939f2a0143a599e031f985f18807 into b0877a1ba3ffb8986d6e724881c8dce5/f1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_) 2023-10-30 06:54:20,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testGetAfterCompaction__co7j6fot1mn32er4dv6dgv0eo1osv6uuc361knoclsvedadul9p70nmotfco25uu/f1/c6fd939f2a0143a599e031f985f18807 2023-10-30 06:54:20,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(1912): b0877a1ba3ffb8986d6e724881c8dce5/f1 is initiating minor compaction 2023-10-30 06:54:20,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@615eb177; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-30 06:54:20,023 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b0877a1ba3ffb8986d6e724881c8dce5/f1 in testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. 2023-10-30 06:54:20,023 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/.tmp, totalSize=10.0 K 2023-10-30 06:54:20,023 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 39f1477e282847e2b1cab792fa16f0e1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 06:54:20,023 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting aee34e6967ed4f77b052afef60039019_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 06:54:20,025 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testGetAfterCompaction' column='f1' 2023-10-30 06:54:20,026 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:20,028 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310301c0c110e53c344818d988bf03d2240ca to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310301c0c110e53c344818d988bf03d2240ca 2023-10-30 06:54:20,030 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231030f0af0e418fcb493aa90f5b06e4a45516 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231030f0af0e418fcb493aa90f5b06e4a45516 2023-10-30 06:54:20,030 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-10-30 06:54:20,030 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 06:54:20,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='testGetAfterCompaction' and column='f1' 2023-10-30 06:54:20,030 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-10-30 06:54:20,031 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:54:20,032 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-30 06:54:20,033 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): b0877a1ba3ffb8986d6e724881c8dce5#f1#compaction#76 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:54:20,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 905 msec 2023-10-30 06:54:20,057 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,057 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,057 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,060 DEBUG [Listener at localhost/40811] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-30 06:54:20,064 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-30 06:54:20,064 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40611] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. 2023-10-30 06:54:20,065 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-10-30 06:54:20,065 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-30 06:54:20,065 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40611] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-30 06:54:20,065 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40611] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. because compaction request was cancelled 2023-10-30 06:54:20,117 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,117 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,117 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,168 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,168 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,168 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,220 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,220 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,220 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,271 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,272 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,272 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,324 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,324 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,324 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,376 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,376 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,376 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,428 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,428 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,428 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,480 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,480 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,480 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,531 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,532 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,532 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,583 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,584 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,584 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,635 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,636 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,636 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,688 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,688 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,688 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,740 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,740 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,740 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,792 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,792 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,793 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,844 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,845 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,845 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,868 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/.tmp/f1/54340c624204495f9500bcdbbb6cfb90 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/54340c624204495f9500bcdbbb6cfb90 2023-10-30 06:54:20,876 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in b0877a1ba3ffb8986d6e724881c8dce5/f1 of b0877a1ba3ffb8986d6e724881c8dce5 into 54340c624204495f9500bcdbbb6cfb90(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:54:20,876 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b0877a1ba3ffb8986d6e724881c8dce5: 2023-10-30 06:54:20,876 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1698648860022; duration=0sec 2023-10-30 06:54:20,876 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:54:20,896 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648859110; access_time=1698648858289; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,896 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/54340c624204495f9500bcdbbb6cfb90; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698648860855; access_time=1698648860030; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,896 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,896 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,942 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_] to archive 2023-10-30 06:54:20,943 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:20,947 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/39f1477e282847e2b1cab792fa16f0e1 2023-10-30 06:54:20,947 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/54340c624204495f9500bcdbbb6cfb90; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698648860855; access_time=1698648860030; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,948 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,948 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698648859965; access_time=1698648859148; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 06:54:20,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/aee34e6967ed4f77b052afef60039019_SeqId_12_ 2023-10-30 06:54:20,999 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/54340c624204495f9500bcdbbb6cfb90; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698648860855; access_time=1698648860030; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:20,999 INFO [Listener at localhost/40811] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698648858266; access_time=1698648857440; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 06:54:21,131 INFO [Listener at localhost/40811] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-10-30 06:54:21,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testGetAfterCompaction 2023-10-30 06:54:21,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-10-30 06:54:21,147 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648861146"}]},"ts":"1698648861146"} 2023-10-30 06:54:21,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-30 06:54:21,148 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-10-30 06:54:21,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-30 06:54:21,271 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-10-30 06:54:21,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=b0877a1ba3ffb8986d6e724881c8dce5, UNASSIGN}] 2023-10-30 06:54:21,279 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=b0877a1ba3ffb8986d6e724881c8dce5, UNASSIGN 2023-10-30 06:54:21,280 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b0877a1ba3ffb8986d6e724881c8dce5, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:21,281 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698648861280"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648861280"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648861280"}]},"ts":"1698648861280"} 2023-10-30 06:54:21,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure b0877a1ba3ffb8986d6e724881c8dce5, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:21,434 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:21,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close b0877a1ba3ffb8986d6e724881c8dce5 2023-10-30 06:54:21,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b0877a1ba3ffb8986d6e724881c8dce5, disabling compactions & flushes 2023-10-30 06:54:21,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. 2023-10-30 06:54:21,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. 2023-10-30 06:54:21,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. after waiting 0 ms 2023-10-30 06:54:21,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. 2023-10-30 06:54:21,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-10-30 06:54:21,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-10-30 06:54:21,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5. 2023-10-30 06:54:21,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b0877a1ba3ffb8986d6e724881c8dce5: 2023-10-30 06:54:21,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed b0877a1ba3ffb8986d6e724881c8dce5 2023-10-30 06:54:21,448 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b0877a1ba3ffb8986d6e724881c8dce5, regionState=CLOSED 2023-10-30 06:54:21,448 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698648861448"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648861448"}]},"ts":"1698648861448"} 2023-10-30 06:54:21,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-30 06:54:21,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-30 06:54:21,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure b0877a1ba3ffb8986d6e724881c8dce5, server=jenkins-hbase20.apache.org,40611,1698648765457 in 167 msec 2023-10-30 06:54:21,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-10-30 06:54:21,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=b0877a1ba3ffb8986d6e724881c8dce5, UNASSIGN in 178 msec 2023-10-30 06:54:21,455 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648861455"}]},"ts":"1698648861455"} 2023-10-30 06:54:21,456 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-10-30 06:54:21,458 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-10-30 06:54:21,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 319 msec 2023-10-30 06:54:21,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-30 06:54:21,754 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-10-30 06:54:21,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testGetAfterCompaction 2023-10-30 06:54:21,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 06:54:21,771 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 06:54:21,773 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 06:54:21,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-10-30 06:54:21,776 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5 2023-10-30 06:54:21,778 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1, FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/recovered.edits] 2023-10-30 06:54:21,781 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/54340c624204495f9500bcdbbb6cfb90 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/54340c624204495f9500bcdbbb6cfb90 2023-10-30 06:54:21,782 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/f1/5d9bd94dd9c048c5ade2dfb50e8ed01c 2023-10-30 06:54:21,784 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/recovered.edits/15.seqid to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5/recovered.edits/15.seqid 2023-10-30 06:54:21,784 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testGetAfterCompaction/b0877a1ba3ffb8986d6e724881c8dce5 2023-10-30 06:54:21,784 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-10-30 06:54:21,785 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-10-30 06:54:21,785 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-10-30 06:54:21,788 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231030a9f8efde892645728acce336d027909c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231030a9f8efde892645728acce336d027909c 2023-10-30 06:54:21,788 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-10-30 06:54:21,790 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 06:54:21,808 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-10-30 06:54:21,810 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-10-30 06:54:21,812 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 06:54:21,812 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-10-30 06:54:21,812 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698648861812"}]},"ts":"9223372036854775807"} 2023-10-30 06:54:21,813 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-30 06:54:21,813 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b0877a1ba3ffb8986d6e724881c8dce5, NAME => 'testGetAfterCompaction,,1698648855306.b0877a1ba3ffb8986d6e724881c8dce5.', STARTKEY => '', ENDKEY => ''}] 2023-10-30 06:54:21,813 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-10-30 06:54:21,814 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1698648861813"}]},"ts":"9223372036854775807"} 2023-10-30 06:54:21,815 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-10-30 06:54:21,816 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 06:54:21,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 53 msec 2023-10-30 06:54:21,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-10-30 06:54:21,876 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-10-30 06:54:21,893 INFO [Listener at localhost/40811] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=245 (was 242) - Thread LEAK? -, OpenFileDescriptor=609 (was 615), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=163 (was 177), ProcessCount=167 (was 167), AvailableMemoryMB=2380 (was 2379) - AvailableMemoryMB LEAK? - 2023-10-30 06:54:21,902 INFO [Listener at localhost/40811] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=245, OpenFileDescriptor=609, MaxFileDescriptor=60000, SystemLoadAverage=163, ProcessCount=167, AvailableMemoryMB=2379 2023-10-30 06:54:21,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 06:54:21,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-10-30 06:54:21,906 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 06:54:21,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-10-30 06:54:21,907 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 06:54:21,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 06:54:21,909 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:21,909 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:21,909 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:21,910 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f empty. 2023-10-30 06:54:21,910 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d empty. 2023-10-30 06:54:21,910 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2 empty. 2023-10-30 06:54:21,910 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:21,910 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:21,910 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:21,910 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-10-30 06:54:22,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 06:54:22,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 06:54:22,322 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-10-30 06:54:22,326 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => fd2fe0ed654295f84d64a2166ce6f05f, NAME => 'testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:54:22,327 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => f040c33a0574cbb9f453444bee0294f2, NAME => 'testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:54:22,327 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 570b991da0936dd868ef50ca1259021d, NAME => 'testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:54:22,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 06:54:22,746 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:22,747 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:22,747 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:22,747 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 570b991da0936dd868ef50ca1259021d, disabling compactions & flushes 2023-10-30 06:54:22,747 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing f040c33a0574cbb9f453444bee0294f2, disabling compactions & flushes 2023-10-30 06:54:22,747 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing fd2fe0ed654295f84d64a2166ce6f05f, disabling compactions & flushes 2023-10-30 06:54:22,748 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:22,747 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:22,748 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:22,748 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:22,748 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. after waiting 0 ms 2023-10-30 06:54:22,748 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:22,749 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:22,748 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:22,749 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:22,749 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. after waiting 0 ms 2023-10-30 06:54:22,749 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:22,749 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. after waiting 0 ms 2023-10-30 06:54:22,749 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:22,750 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:22,750 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:22,750 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:22,750 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:22,750 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:22,753 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 06:54:22,754 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648862754"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648862754"}]},"ts":"1698648862754"} 2023-10-30 06:54:22,755 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698648862754"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648862754"}]},"ts":"1698648862754"} 2023-10-30 06:54:22,755 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648862754"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648862754"}]},"ts":"1698648862754"} 2023-10-30 06:54:22,757 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 06:54:22,758 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 06:54:22,758 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648862758"}]},"ts":"1698648862758"} 2023-10-30 06:54:22,759 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-10-30 06:54:22,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd2fe0ed654295f84d64a2166ce6f05f, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=570b991da0936dd868ef50ca1259021d, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f040c33a0574cbb9f453444bee0294f2, ASSIGN}] 2023-10-30 06:54:22,764 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd2fe0ed654295f84d64a2166ce6f05f, ASSIGN 2023-10-30 06:54:22,764 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f040c33a0574cbb9f453444bee0294f2, ASSIGN 2023-10-30 06:54:22,764 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=570b991da0936dd868ef50ca1259021d, ASSIGN 2023-10-30 06:54:22,765 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd2fe0ed654295f84d64a2166ce6f05f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:54:22,765 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=570b991da0936dd868ef50ca1259021d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:54:22,765 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f040c33a0574cbb9f453444bee0294f2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:54:22,918 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=fd2fe0ed654295f84d64a2166ce6f05f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:22,918 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=f040c33a0574cbb9f453444bee0294f2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:22,918 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648862918"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648862918"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648862918"}]},"ts":"1698648862918"} 2023-10-30 06:54:22,919 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648862918"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648862918"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648862918"}]},"ts":"1698648862918"} 2023-10-30 06:54:22,918 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=570b991da0936dd868ef50ca1259021d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:22,919 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698648862918"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648862918"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648862918"}]},"ts":"1698648862918"} 2023-10-30 06:54:22,922 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure fd2fe0ed654295f84d64a2166ce6f05f, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:22,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure f040c33a0574cbb9f453444bee0294f2, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:22,926 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure 570b991da0936dd868ef50ca1259021d, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:23,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 06:54:23,077 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:23,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:23,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 570b991da0936dd868ef50ca1259021d, NAME => 'testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 06:54:23,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:23,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:23,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:23,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:23,087 INFO [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:23,089 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1 2023-10-30 06:54:23,089 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1 2023-10-30 06:54:23,089 INFO [StoreOpener-570b991da0936dd868ef50ca1259021d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 570b991da0936dd868ef50ca1259021d columnFamilyName family1 2023-10-30 06:54:23,092 INFO [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(310): Store=570b991da0936dd868ef50ca1259021d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:23,092 INFO [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:23,094 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2 2023-10-30 06:54:23,095 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2 2023-10-30 06:54:23,095 INFO [StoreOpener-570b991da0936dd868ef50ca1259021d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 570b991da0936dd868ef50ca1259021d columnFamilyName family2 2023-10-30 06:54:23,098 INFO [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(310): Store=570b991da0936dd868ef50ca1259021d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:23,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:23,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:23,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:54:23,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:23,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:54:23,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 570b991da0936dd868ef50ca1259021d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63079497, jitterRate=-0.06004224717617035}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:54:23,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:23,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d., pid=85, masterSystemTime=1698648863077 2023-10-30 06:54:23,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:23,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:23,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:23,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f040c33a0574cbb9f453444bee0294f2, NAME => 'testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 06:54:23,108 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=570b991da0936dd868ef50ca1259021d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:23,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:23,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:23,108 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698648863108"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648863108"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648863108"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648863108"}]},"ts":"1698648863108"} 2023-10-30 06:54:23,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:23,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:23,109 INFO [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:23,111 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1 2023-10-30 06:54:23,111 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1 2023-10-30 06:54:23,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=81 2023-10-30 06:54:23,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure 570b991da0936dd868ef50ca1259021d, server=jenkins-hbase20.apache.org,40611,1698648765457 in 184 msec 2023-10-30 06:54:23,111 INFO [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f040c33a0574cbb9f453444bee0294f2 columnFamilyName family1 2023-10-30 06:54:23,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=570b991da0936dd868ef50ca1259021d, ASSIGN in 350 msec 2023-10-30 06:54:23,112 INFO [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(310): Store=f040c33a0574cbb9f453444bee0294f2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:23,112 INFO [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:23,113 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2 2023-10-30 06:54:23,113 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2 2023-10-30 06:54:23,114 INFO [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f040c33a0574cbb9f453444bee0294f2 columnFamilyName family2 2023-10-30 06:54:23,114 INFO [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(310): Store=f040c33a0574cbb9f453444bee0294f2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:23,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:23,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:23,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:54:23,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:23,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:54:23,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f040c33a0574cbb9f453444bee0294f2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68547652, jitterRate=0.02143961191177368}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:54:23,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:23,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2., pid=84, masterSystemTime=1698648863077 2023-10-30 06:54:23,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:23,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:23,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:23,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fd2fe0ed654295f84d64a2166ce6f05f, NAME => 'testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 06:54:23,122 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=f040c33a0574cbb9f453444bee0294f2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:23,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:23,123 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648863122"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648863122"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648863122"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648863122"}]},"ts":"1698648863122"} 2023-10-30 06:54:23,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:23,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:23,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:23,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=82 2023-10-30 06:54:23,126 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure f040c33a0574cbb9f453444bee0294f2, server=jenkins-hbase20.apache.org,40611,1698648765457 in 201 msec 2023-10-30 06:54:23,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f040c33a0574cbb9f453444bee0294f2, ASSIGN in 364 msec 2023-10-30 06:54:23,129 INFO [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:23,131 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1 2023-10-30 06:54:23,131 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1 2023-10-30 06:54:23,131 INFO [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd2fe0ed654295f84d64a2166ce6f05f columnFamilyName family1 2023-10-30 06:54:23,132 INFO [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(310): Store=fd2fe0ed654295f84d64a2166ce6f05f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:23,132 INFO [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:23,133 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2 2023-10-30 06:54:23,133 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2 2023-10-30 06:54:23,133 INFO [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd2fe0ed654295f84d64a2166ce6f05f columnFamilyName family2 2023-10-30 06:54:23,134 INFO [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(310): Store=fd2fe0ed654295f84d64a2166ce6f05f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:23,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:23,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:23,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:54:23,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:23,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:54:23,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened fd2fe0ed654295f84d64a2166ce6f05f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59702581, jitterRate=-0.1103622168302536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:54:23,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:23,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f., pid=83, masterSystemTime=1698648863077 2023-10-30 06:54:23,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:23,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:23,141 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=fd2fe0ed654295f84d64a2166ce6f05f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:23,141 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648863141"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648863141"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648863141"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648863141"}]},"ts":"1698648863141"} 2023-10-30 06:54:23,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=80 2023-10-30 06:54:23,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure fd2fe0ed654295f84d64a2166ce6f05f, server=jenkins-hbase20.apache.org,40611,1698648765457 in 221 msec 2023-10-30 06:54:23,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=80, resume processing ppid=79 2023-10-30 06:54:23,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd2fe0ed654295f84d64a2166ce6f05f, ASSIGN in 383 msec 2023-10-30 06:54:23,145 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 06:54:23,145 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648863145"}]},"ts":"1698648863145"} 2023-10-30 06:54:23,146 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-10-30 06:54:23,148 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 06:54:23,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2440 sec 2023-10-30 06:54:24,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 06:54:24,018 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-10-30 06:54:24,028 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:24,029 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:24,029 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:24,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:24,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 06:54:24,033 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 06:54:24,033 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:24,033 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 06:54:24,033 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 06:54:24,034 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:24,034 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:24,034 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:24,034 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:24,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:24,035 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:24,035 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:24,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:24,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:24,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:24,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:24,035 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 06:54:24,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 06:54:24,035 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 06:54:24,036 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:24,036 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 06:54:24,036 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:24,036 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. started... 2023-10-30 06:54:24,036 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:54:24,036 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:24,036 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:24,036 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fd2fe0ed654295f84d64a2166ce6f05f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 06:54:24,036 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. started... 2023-10-30 06:54:24,036 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:24,037 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. started... 2023-10-30 06:54:24,037 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 570b991da0936dd868ef50ca1259021d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 06:54:24,038 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f040c33a0574cbb9f453444bee0294f2 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 06:54:24,460 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310305edcfbddcf684a71835737c85f5bd817 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305edcfbddcf684a71835737c85f5bd817 2023-10-30 06:54:24,461 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030a59c36962fd24b01ae640827bf734827 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030a59c36962fd24b01ae640827bf734827 2023-10-30 06:54:24,461 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030dc210fd1a1134fa3bef38f932b251031 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030dc210fd1a1134fa3bef38f932b251031 2023-10-30 06:54:24,868 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family1/b95281a1720c482b9ec17a02a87d6b65 2023-10-30 06:54:24,868 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family1/a41eae486c58411297cc1080d02cc7f6 2023-10-30 06:54:24,868 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family1/dc3f481d4da4462b8763896c8e74cbda 2023-10-30 06:54:25,295 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103045cf442326eb466d84c3301d31c8c3f7 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103045cf442326eb466d84c3301d31c8c3f7 2023-10-30 06:54:25,296 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030d1860b52464b42c39fd00d4ed9a3c346 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030d1860b52464b42c39fd00d4ed9a3c346 2023-10-30 06:54:25,296 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030e828ace505c74030bfecc47a9f5ab8da to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e828ace505c74030bfecc47a9f5ab8da 2023-10-30 06:54:25,705 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family2/19947e0cbcef4f759642e84ac7b612ca 2023-10-30 06:54:25,705 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family2/4c3c36b07c38401baf150fc472fcdae5 2023-10-30 06:54:25,706 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family2/fca7c332984945bc80b348cc51442c60 2023-10-30 06:54:25,715 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family1/b95281a1720c482b9ec17a02a87d6b65 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/b95281a1720c482b9ec17a02a87d6b65 2023-10-30 06:54:25,715 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family1/a41eae486c58411297cc1080d02cc7f6 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a41eae486c58411297cc1080d02cc7f6 2023-10-30 06:54:25,715 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family1/dc3f481d4da4462b8763896c8e74cbda as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/dc3f481d4da4462b8763896c8e74cbda 2023-10-30 06:54:25,720 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a41eae486c58411297cc1080d02cc7f6, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 06:54:25,720 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/dc3f481d4da4462b8763896c8e74cbda, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 06:54:25,720 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/b95281a1720c482b9ec17a02a87d6b65, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 06:54:25,721 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family2/4c3c36b07c38401baf150fc472fcdae5 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/4c3c36b07c38401baf150fc472fcdae5 2023-10-30 06:54:25,721 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family2/fca7c332984945bc80b348cc51442c60 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/fca7c332984945bc80b348cc51442c60 2023-10-30 06:54:25,721 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family2/19947e0cbcef4f759642e84ac7b612ca as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/19947e0cbcef4f759642e84ac7b612ca 2023-10-30 06:54:25,726 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/19947e0cbcef4f759642e84ac7b612ca, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 06:54:25,726 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/fca7c332984945bc80b348cc51442c60, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 06:54:25,726 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/4c3c36b07c38401baf150fc472fcdae5, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 06:54:25,727 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 570b991da0936dd868ef50ca1259021d in 1690ms, sequenceid=5, compaction requested=false 2023-10-30 06:54:25,727 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for fd2fe0ed654295f84d64a2166ce6f05f in 1691ms, sequenceid=5, compaction requested=false 2023-10-30 06:54:25,727 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-30 06:54:25,727 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-30 06:54:25,729 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:25,729 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:25,729 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:25,729 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f040c33a0574cbb9f453444bee0294f2 in 1691ms, sequenceid=5, compaction requested=false 2023-10-30 06:54:25,729 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:54:25,729 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:25,729 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:25,729 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:54:25,729 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:25,729 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:54:25,729 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:54:25,729 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,729 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 06:54:25,729 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 06:54:25,730 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:25,730 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:25,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:25,730 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:25,730 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:25,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:25,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:25,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:25,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:25,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 06:54:25,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67f4bee9[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:25,731 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 06:54:25,731 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:25,732 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:25,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:25,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:25,732 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 06:54:25,732 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 06:54:25,732 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:25,732 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,732 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:25,733 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,733 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 06:54:25,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:25,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:25,733 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:25,733 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 06:54:25,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:25,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:25,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:25,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:25,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:25,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:25,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 06:54:25,735 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 06:54:25,735 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:25,735 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:25,735 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 06:54:25,735 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:25,735 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:25,735 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:25,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:25,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:25,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:25,736 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:25,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:25,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:25,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:25,736 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:25,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:25,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:25,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:25,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:25,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:25,737 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:25,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:25,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,738 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,738 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:25,738 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:25,738 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:25,738 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:25,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:25,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 06:54:25,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:25,738 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:25,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:25,738 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,738 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:25,738 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:25,738 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:25,738 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:25,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:25,738 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:25,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:25,839 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:25,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:25,841 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:25,841 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:25,842 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:25,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:25,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:25,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 06:54:25,848 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 06:54:25,848 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:25,848 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 06:54:25,848 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 06:54:25,849 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:25,849 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:25,850 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,850 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:25,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:25,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:25,850 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:25,850 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:25,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:25,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:25,851 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 06:54:25,851 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-30 06:54:25,851 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 06:54:25,851 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 06:54:25,851 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:25,851 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 06:54:25,854 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:25,854 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. started... 2023-10-30 06:54:25,854 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:25,854 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:54:25,854 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:25,855 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. started... 2023-10-30 06:54:25,854 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:25,854 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fd2fe0ed654295f84d64a2166ce6f05f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 06:54:25,854 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. started... 2023-10-30 06:54:25,855 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f040c33a0574cbb9f453444bee0294f2 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 06:54:25,855 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 570b991da0936dd868ef50ca1259021d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 06:54:25,878 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310300f8da9cf0fb940a5818d169aa3781714 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310300f8da9cf0fb940a5818d169aa3781714 2023-10-30 06:54:26,284 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family1/0133c3bcd7234223b3f1953aa36bf981 2023-10-30 06:54:26,288 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030021113c107314bdf8c0b47d024258ba4 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030021113c107314bdf8c0b47d024258ba4 2023-10-30 06:54:26,288 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310305dbea680af974ad09bf5c3e588e97cb9 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310305dbea680af974ad09bf5c3e588e97cb9 2023-10-30 06:54:26,697 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family1/7f09297a98814e8fb694af5775f3ab6a 2023-10-30 06:54:26,699 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family1/2d93a80180a04d768aad4a10056d9f3d 2023-10-30 06:54:26,708 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103040541d6f6b0f4a7d885d9da46483911b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103040541d6f6b0f4a7d885d9da46483911b 2023-10-30 06:54:26,949 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 06:54:27,115 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family2/ab029fd919ee4a8789fc32de37bafa2c 2023-10-30 06:54:27,124 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030e6c55353907d47c99ad7c3702a2369a7 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e6c55353907d47c99ad7c3702a2369a7 2023-10-30 06:54:27,125 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family1/0133c3bcd7234223b3f1953aa36bf981 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/0133c3bcd7234223b3f1953aa36bf981 2023-10-30 06:54:27,125 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030458075cd4ece432fa89db1a3aad8b026 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030458075cd4ece432fa89db1a3aad8b026 2023-10-30 06:54:27,131 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/0133c3bcd7234223b3f1953aa36bf981, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 06:54:27,132 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family2/ab029fd919ee4a8789fc32de37bafa2c as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/ab029fd919ee4a8789fc32de37bafa2c 2023-10-30 06:54:27,135 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/ab029fd919ee4a8789fc32de37bafa2c, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 06:54:27,136 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for fd2fe0ed654295f84d64a2166ce6f05f in 1282ms, sequenceid=9, compaction requested=false 2023-10-30 06:54:27,136 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:27,136 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:27,136 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:54:27,533 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family2/de8c6da443c44db4962a4fe779a42cb7 2023-10-30 06:54:27,533 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family2/fd4594129f1249819d49581025e122ab 2023-10-30 06:54:27,544 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family1/2d93a80180a04d768aad4a10056d9f3d as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2d93a80180a04d768aad4a10056d9f3d 2023-10-30 06:54:27,545 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family1/7f09297a98814e8fb694af5775f3ab6a as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/7f09297a98814e8fb694af5775f3ab6a 2023-10-30 06:54:27,551 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2d93a80180a04d768aad4a10056d9f3d, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 06:54:27,551 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/7f09297a98814e8fb694af5775f3ab6a, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 06:54:27,552 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family2/de8c6da443c44db4962a4fe779a42cb7 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/de8c6da443c44db4962a4fe779a42cb7 2023-10-30 06:54:27,552 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family2/fd4594129f1249819d49581025e122ab as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/fd4594129f1249819d49581025e122ab 2023-10-30 06:54:27,556 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/fd4594129f1249819d49581025e122ab, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 06:54:27,556 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/de8c6da443c44db4962a4fe779a42cb7, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 06:54:27,556 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 570b991da0936dd868ef50ca1259021d in 1701ms, sequenceid=9, compaction requested=false 2023-10-30 06:54:27,556 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f040c33a0574cbb9f453444bee0294f2 in 1701ms, sequenceid=9, compaction requested=false 2023-10-30 06:54:27,556 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:27,557 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:27,557 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:27,557 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:27,557 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:54:27,557 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:54:27,557 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:54:27,557 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,557 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 06:54:27,557 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 06:54:27,558 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,558 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:27,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:27,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:27,558 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:27,558 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:27,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:27,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:27,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:27,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:27,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 06:54:27,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c023c2d[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:27,559 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 06:54:27,559 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:27,560 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:27,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:27,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:27,560 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 06:54:27,560 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 06:54:27,560 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:27,560 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,560 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:27,561 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 06:54:27,561 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,561 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:27,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:27,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:27,561 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 06:54:27,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:27,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:27,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:27,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:27,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:27,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:27,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 06:54:27,563 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 06:54:27,563 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:27,563 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:27,563 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 06:54:27,563 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:27,564 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:27,564 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:27,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:27,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:27,564 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:27,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:27,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:27,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:27,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:27,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:27,565 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:27,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:27,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:27,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:27,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:27,566 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:27,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:27,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,568 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,568 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:27,568 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:27,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:27,568 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:27,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 06:54:27,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:27,568 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:27,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:27,568 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:27,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-30 06:54:27,568 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,569 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:27,569 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:27,569 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:27,569 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:27,569 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:27,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:27,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:27,669 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:27,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:27,673 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:27,674 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:27,674 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:27,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:27,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:27,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 06:54:27,686 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 06:54:27,686 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:27,686 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 06:54:27,686 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 06:54:27,686 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:27,686 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:27,687 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,687 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:27,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:27,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:27,688 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:27,688 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:27,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:27,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:27,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:27,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:27,688 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 06:54:27,689 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-30 06:54:27,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 06:54:27,689 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 06:54:27,689 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:27,689 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 06:54:27,689 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:27,689 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. started... 2023-10-30 06:54:27,689 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:54:27,689 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:27,689 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:27,689 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:27,689 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fd2fe0ed654295f84d64a2166ce6f05f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 06:54:27,689 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. started... 2023-10-30 06:54:27,689 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. started... 2023-10-30 06:54:27,689 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 570b991da0936dd868ef50ca1259021d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 06:54:27,689 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f040c33a0574cbb9f453444bee0294f2 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 06:54:27,809 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:54:27,809 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-10-30 06:54:27,809 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e456136 to 127.0.0.1:50449 2023-10-30 06:54:27,809 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:54:27,809 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01405f67 to 127.0.0.1:50449 2023-10-30 06:54:27,809 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:54:27,809 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:54:27,809 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x355e1f6f to 127.0.0.1:50449 2023-10-30 06:54:27,810 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:54:27,810 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:54:27,810 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x625d3140 to 127.0.0.1:50449 2023-10-30 06:54:27,810 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:54:28,230 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310303a5284afcab8411081ce6613ef912e22 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310303a5284afcab8411081ce6613ef912e22 2023-10-30 06:54:28,230 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310303fceef27fc2d4879992154582c6d8bab to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310303fceef27fc2d4879992154582c6d8bab 2023-10-30 06:54:28,230 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030d9eea4afc2d84573bb823800ab8f4715 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030d9eea4afc2d84573bb823800ab8f4715 2023-10-30 06:54:28,640 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family1/40770f8b14244f33ab8455fefea8d2ef 2023-10-30 06:54:28,641 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family1/a981bc4dceb146cdaedd5eabb59ba867 2023-10-30 06:54:28,641 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family1/d8eed4b92a704b0792b454c0e5bbae8a 2023-10-30 06:54:29,070 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030db1bf67698e7468c8b6b4bb85f5a8179 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030db1bf67698e7468c8b6b4bb85f5a8179 2023-10-30 06:54:29,070 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030e201ac04e37d48f3ae323cedfd079f7c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e201ac04e37d48f3ae323cedfd079f7c 2023-10-30 06:54:29,070 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030c15b5113113243c4b0bdaf6f027e2b48 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030c15b5113113243c4b0bdaf6f027e2b48 2023-10-30 06:54:29,075 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family2/e630c91fb8df4e43aff22d715e18a0af 2023-10-30 06:54:29,079 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family1/a981bc4dceb146cdaedd5eabb59ba867 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a981bc4dceb146cdaedd5eabb59ba867 2023-10-30 06:54:29,083 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a981bc4dceb146cdaedd5eabb59ba867, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 06:54:29,084 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family2/e630c91fb8df4e43aff22d715e18a0af as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/e630c91fb8df4e43aff22d715e18a0af 2023-10-30 06:54:29,088 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/e630c91fb8df4e43aff22d715e18a0af, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 06:54:29,089 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f040c33a0574cbb9f453444bee0294f2 in 1400ms, sequenceid=13, compaction requested=true 2023-10-30 06:54:29,089 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:29,089 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:29,089 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:54:29,476 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family2/0504fd6f8ad2495d8fbf2f3069916bbf 2023-10-30 06:54:29,476 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family2/618962d22cca49e5b9a996d4747b7f1f 2023-10-30 06:54:29,488 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family1/d8eed4b92a704b0792b454c0e5bbae8a as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d8eed4b92a704b0792b454c0e5bbae8a 2023-10-30 06:54:29,489 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family1/40770f8b14244f33ab8455fefea8d2ef as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/40770f8b14244f33ab8455fefea8d2ef 2023-10-30 06:54:29,493 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d8eed4b92a704b0792b454c0e5bbae8a, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 06:54:29,493 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/40770f8b14244f33ab8455fefea8d2ef, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 06:54:29,494 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family2/0504fd6f8ad2495d8fbf2f3069916bbf as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/0504fd6f8ad2495d8fbf2f3069916bbf 2023-10-30 06:54:29,494 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family2/618962d22cca49e5b9a996d4747b7f1f as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/618962d22cca49e5b9a996d4747b7f1f 2023-10-30 06:54:29,499 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/0504fd6f8ad2495d8fbf2f3069916bbf, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 06:54:29,499 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/618962d22cca49e5b9a996d4747b7f1f, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 06:54:29,499 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 570b991da0936dd868ef50ca1259021d in 1810ms, sequenceid=13, compaction requested=true 2023-10-30 06:54:29,499 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for fd2fe0ed654295f84d64a2166ce6f05f in 1810ms, sequenceid=13, compaction requested=true 2023-10-30 06:54:29,500 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:29,500 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:29,500 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:29,500 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:29,500 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:54:29,500 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:54:29,500 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:54:29,500 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,500 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 06:54:29,500 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 06:54:29,502 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,502 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:29,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:29,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:29,502 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:29,502 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:29,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:29,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:29,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:29,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:29,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 06:54:29,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7524503b[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:29,504 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 06:54:29,504 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:29,505 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:29,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:29,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:29,505 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 06:54:29,505 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 06:54:29,505 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,505 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:29,505 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:29,506 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 06:54:29,506 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,506 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:29,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:29,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:29,506 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 06:54:29,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:29,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:29,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:29,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:29,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:29,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:29,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 06:54:29,509 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 06:54:29,509 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:29,509 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:29,509 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 06:54:29,509 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:29,510 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:29,510 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:29,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:29,510 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:29,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:29,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:29,511 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:29,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:29,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:29,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:29,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,512 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:29,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:29,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,513 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:29,513 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:29,514 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:29,513 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:29,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 06:54:29,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:29,514 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:29,514 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:29,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:29,514 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,514 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:29,514 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:29,514 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:29,514 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:29,514 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:29,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:29,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:29,614 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:29,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:29,620 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:29,621 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:29,621 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:29,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:29,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:29,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 06:54:29,629 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 06:54:29,629 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:29,629 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 06:54:29,629 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 06:54:29,630 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:29,630 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:29,630 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,630 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:29,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:29,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:29,631 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:29,631 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:29,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:29,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:29,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:29,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:29,631 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 06:54:29,631 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-30 06:54:29,632 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 06:54:29,632 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 06:54:29,632 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:29,632 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 06:54:29,632 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:29,632 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:54:29,632 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:29,632 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:29,632 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:29,632 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. started... 2023-10-30 06:54:29,632 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. started... 2023-10-30 06:54:29,632 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. started... 2023-10-30 06:54:29,632 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 570b991da0936dd868ef50ca1259021d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 06:54:29,632 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fd2fe0ed654295f84d64a2166ce6f05f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 06:54:29,632 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f040c33a0574cbb9f453444bee0294f2 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 06:54:29,651 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030ad5a576fe6a347fa83c01cded63f3d5a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030ad5a576fe6a347fa83c01cded63f3d5a 2023-10-30 06:54:30,057 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family1/e9293e91bcc441c3bb7ecbf6ae816e8c 2023-10-30 06:54:30,059 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030ff860f014ef44e1087112c5907e73e42 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ff860f014ef44e1087112c5907e73e42 2023-10-30 06:54:30,060 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030f7f635e224be4126ba2ba1be9fcf3e5a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030f7f635e224be4126ba2ba1be9fcf3e5a 2023-10-30 06:54:30,471 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family1/833c20f5c1334866b4f63be6e638fcd8 2023-10-30 06:54:30,474 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family1/d952b53beec64936896c3e5e46d2c1e8 2023-10-30 06:54:30,485 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103065452d661ff749ed9f7b90ecbdd8a845 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103065452d661ff749ed9f7b90ecbdd8a845 2023-10-30 06:54:30,494 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family2/d6922695a3a84331b7d8e02c3b7aa2cb 2023-10-30 06:54:30,498 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family1/e9293e91bcc441c3bb7ecbf6ae816e8c as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/e9293e91bcc441c3bb7ecbf6ae816e8c 2023-10-30 06:54:30,501 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/e9293e91bcc441c3bb7ecbf6ae816e8c, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 06:54:30,501 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family2/d6922695a3a84331b7d8e02c3b7aa2cb as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/d6922695a3a84331b7d8e02c3b7aa2cb 2023-10-30 06:54:30,505 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/d6922695a3a84331b7d8e02c3b7aa2cb, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 06:54:30,506 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for fd2fe0ed654295f84d64a2166ce6f05f in 874ms, sequenceid=17, compaction requested=true 2023-10-30 06:54:30,506 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:30,506 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:30,506 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:54:30,905 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103006b9b664c5514c9fa1153865383cdf81 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103006b9b664c5514c9fa1153865383cdf81 2023-10-30 06:54:30,906 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030f1414fcead4c4e1ebaca22d0f411a50b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030f1414fcead4c4e1ebaca22d0f411a50b 2023-10-30 06:54:31,314 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family2/99125cfc1c274a58b5463561f1bd5ea2 2023-10-30 06:54:31,314 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family2/56fe2f93c1894199acc149c0f92b364a 2023-10-30 06:54:31,324 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family1/d952b53beec64936896c3e5e46d2c1e8 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d952b53beec64936896c3e5e46d2c1e8 2023-10-30 06:54:31,324 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family1/833c20f5c1334866b4f63be6e638fcd8 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/833c20f5c1334866b4f63be6e638fcd8 2023-10-30 06:54:31,327 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d952b53beec64936896c3e5e46d2c1e8, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 06:54:31,328 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/833c20f5c1334866b4f63be6e638fcd8, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 06:54:31,328 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family2/99125cfc1c274a58b5463561f1bd5ea2 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/99125cfc1c274a58b5463561f1bd5ea2 2023-10-30 06:54:31,328 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family2/56fe2f93c1894199acc149c0f92b364a as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/56fe2f93c1894199acc149c0f92b364a 2023-10-30 06:54:31,332 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/99125cfc1c274a58b5463561f1bd5ea2, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 06:54:31,332 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/56fe2f93c1894199acc149c0f92b364a, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 06:54:31,333 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f040c33a0574cbb9f453444bee0294f2 in 1701ms, sequenceid=17, compaction requested=true 2023-10-30 06:54:31,333 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 570b991da0936dd868ef50ca1259021d in 1701ms, sequenceid=17, compaction requested=true 2023-10-30 06:54:31,333 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:31,333 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:31,333 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:31,333 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:54:31,333 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:31,333 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:54:31,333 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:54:31,333 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,334 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 06:54:31,334 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 06:54:31,335 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,335 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:31,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:31,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:31,335 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:31,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:31,335 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:31,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:31,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:31,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:31,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 06:54:31,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7af12994[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:31,337 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 06:54:31,337 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:31,337 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:31,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:31,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:31,337 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 06:54:31,337 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 06:54:31,337 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:31,337 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,337 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:31,338 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,338 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 06:54:31,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:31,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:31,338 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:31,338 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 06:54:31,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:31,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:31,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:31,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:31,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:31,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:31,340 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 06:54:31,340 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:31,340 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:31,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 06:54:31,340 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 06:54:31,340 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:31,341 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:31,341 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:31,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:31,341 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:31,341 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:31,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:31,342 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:31,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,343 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,343 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:31,343 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:31,343 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:31,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 06:54:31,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:31,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-30 06:54:31,343 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:31,343 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:31,343 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:31,344 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:31,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:31,343 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:31,344 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:31,344 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:31,344 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:31,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:31,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:31,444 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:31,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:31,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 06:54:31,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698648871464 (current time:1698648871464). 2023-10-30 06:54:31,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-30 06:54:31,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] zookeeper.ReadOnlyZKClient(139): Connect 0x6058a064 to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:54:31,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62a7f8e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:54:31,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:54:31,478 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:54:31,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6058a064 to 127.0.0.1:50449 2023-10-30 06:54:31,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:54:31,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-30 06:54:31,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 06:54:31,488 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot, current working dir path: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot/.tmp/snaptb-1698648871447 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-30 06:54:31,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 06:54:31,498 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 06:54:31,499 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698649471499 2023-10-30 06:54:31,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 06:54:31,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1698648871447 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-10-30 06:54:31,500 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 06:54:31,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-30 06:54:31,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-10-30 06:54:31,502 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-30 06:54:31,502 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1698649471502 2023-10-30 06:54:31,504 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:31,504 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-30 06:54:31,605 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 06:54:31,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 06:54:31,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 06:54:31,609 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-30 06:54:31,809 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 06:54:31,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 06:54:31,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 06:54:31,811 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-30 06:54:31,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1698648871447 2023-10-30 06:54:31,911 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1698648871447' 2023-10-30 06:54:31,911 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-30 06:54:31,911 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1698648871447' starting 'acquire' 2023-10-30 06:54:31,911 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1698648871447', kicking off acquire phase on members. 2023-10-30 06:54:31,912 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698648871447 2023-10-30 06:54:31,912 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1698648871447 2023-10-30 06:54:31,912 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1698648871447/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,912 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-30 06:54:31,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-30 06:54:31,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-30 06:54:31,913 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1698648871447/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,913 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:31,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1698648871447 2023-10-30 06:54:31,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698648871447 2023-10-30 06:54:31,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-10-30 06:54:31,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1698648871447 2023-10-30 06:54:31,915 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1698648871447 from table testCompactionWithHFileLink type FLUSH 2023-10-30 06:54:31,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1698648871447 2023-10-30 06:54:31,917 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1698648871447' with timeout 300000ms 2023-10-30 06:54:31,917 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-30 06:54:31,917 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1698648871447' starting 'acquire' stage 2023-10-30 06:54:31,917 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1698648871447' locally acquired 2023-10-30 06:54:31,917 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (snaptb-1698648871447) in zk 2023-10-30 06:54:31,921 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1698648871447 2023-10-30 06:54:31,921 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698648871447/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1698648871447/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-30 06:54:31,921 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698648871447 2023-10-30 06:54:31,921 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1698648871447' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:31,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:31,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:31,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698648871447 2023-10-30 06:54:31,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:31,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'snaptb-1698648871447' on coordinator 2023-10-30 06:54:31,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3830d3d5[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:31,923 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1698648871447' starting 'in-barrier' execution. 2023-10-30 06:54:31,923 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1698648871447 2023-10-30 06:54:31,932 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698648871447 2023-10-30 06:54:31,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1698648871447 2023-10-30 06:54:31,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1698648871447 2023-10-30 06:54:31,932 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1698648871447' received 'reached' from coordinator. 2023-10-30 06:54:31,932 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698648871447/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:31,932 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:31,933 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:31,933 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:31,933 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-10-30 06:54:31,933 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:31,933 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-30 06:54:31,933 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. started... 2023-10-30 06:54:31,933 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. started... 2023-10-30 06:54:31,933 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. started... 2023-10-30 06:54:31,933 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:31,933 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:31,933 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:31,934 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.' region-info for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,934 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.' region-info for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,934 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.' region-info for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,941 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-30 06:54:31,941 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-30 06:54:31,941 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-30 06:54:31,946 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/dc3f481d4da4462b8763896c8e74cbda, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/0133c3bcd7234223b3f1953aa36bf981, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/40770f8b14244f33ab8455fefea8d2ef, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/e9293e91bcc441c3bb7ecbf6ae816e8c] hfiles 2023-10-30 06:54:31,946 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a41eae486c58411297cc1080d02cc7f6, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2d93a80180a04d768aad4a10056d9f3d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a981bc4dceb146cdaedd5eabb59ba867, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/833c20f5c1334866b4f63be6e638fcd8] hfiles 2023-10-30 06:54:31,946 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a41eae486c58411297cc1080d02cc7f6 for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,946 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/b95281a1720c482b9ec17a02a87d6b65, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/7f09297a98814e8fb694af5775f3ab6a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d8eed4b92a704b0792b454c0e5bbae8a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d952b53beec64936896c3e5e46d2c1e8] hfiles 2023-10-30 06:54:31,946 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/dc3f481d4da4462b8763896c8e74cbda for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,946 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/b95281a1720c482b9ec17a02a87d6b65 for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2d93a80180a04d768aad4a10056d9f3d for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a981bc4dceb146cdaedd5eabb59ba867 for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/833c20f5c1334866b4f63be6e638fcd8 for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/0133c3bcd7234223b3f1953aa36bf981 for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/7f09297a98814e8fb694af5775f3ab6a for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d8eed4b92a704b0792b454c0e5bbae8a for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d952b53beec64936896c3e5e46d2c1e8 for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/4c3c36b07c38401baf150fc472fcdae5, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/de8c6da443c44db4962a4fe779a42cb7, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/e630c91fb8df4e43aff22d715e18a0af, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/56fe2f93c1894199acc149c0f92b364a] hfiles 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/4c3c36b07c38401baf150fc472fcdae5 for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/de8c6da443c44db4962a4fe779a42cb7 for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/e630c91fb8df4e43aff22d715e18a0af for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/56fe2f93c1894199acc149c0f92b364a for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/40770f8b14244f33ab8455fefea8d2ef for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/19947e0cbcef4f759642e84ac7b612ca, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/fd4594129f1249819d49581025e122ab, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/0504fd6f8ad2495d8fbf2f3069916bbf, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/99125cfc1c274a58b5463561f1bd5ea2] hfiles 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/e9293e91bcc441c3bb7ecbf6ae816e8c for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,949 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/19947e0cbcef4f759642e84ac7b612ca for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,950 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/fca7c332984945bc80b348cc51442c60, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/ab029fd919ee4a8789fc32de37bafa2c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/618962d22cca49e5b9a996d4747b7f1f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/d6922695a3a84331b7d8e02c3b7aa2cb] hfiles 2023-10-30 06:54:31,950 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/fca7c332984945bc80b348cc51442c60 for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,950 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/fd4594129f1249819d49581025e122ab for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,950 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/ab029fd919ee4a8789fc32de37bafa2c for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,950 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/618962d22cca49e5b9a996d4747b7f1f for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,950 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/0504fd6f8ad2495d8fbf2f3069916bbf for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,950 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/d6922695a3a84331b7d8e02c3b7aa2cb for snapshot=snaptb-1698648871447 2023-10-30 06:54:31,950 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/99125cfc1c274a58b5463561f1bd5ea2 for snapshot=snaptb-1698648871447 2023-10-30 06:54:32,111 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 06:54:32,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 06:54:32,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 06:54:32,113 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-30 06:54:32,356 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. completed. 2023-10-30 06:54:32,356 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:32,358 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-10-30 06:54:32,360 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. completed. 2023-10-30 06:54:32,361 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:32,361 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. completed. 2023-10-30 06:54:32,361 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:32,361 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-10-30 06:54:32,361 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-10-30 06:54:32,361 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-10-30 06:54:32,361 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:32,361 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1698648871447' locally completed 2023-10-30 06:54:32,362 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1698648871447' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:32,363 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1698648871447' has notified controller of completion 2023-10-30 06:54:32,364 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:32,364 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1698648871447' completed. 2023-10-30 06:54:32,363 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698648871447/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:32,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1698648871447/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:32,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:32,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-30 06:54:32,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:32,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:32,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698648871447 2023-10-30 06:54:32,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:32,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:32,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698648871447 2023-10-30 06:54:32,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:32,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1698648871447' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:32,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'snaptb-1698648871447', counting down latch. Waiting for 0 more 2023-10-30 06:54:32,369 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1698648871447' execution completed 2023-10-30 06:54:32,369 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:32,369 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:32,369 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1698648871447 2023-10-30 06:54:32,369 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1698648871447including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-30 06:54:32,373 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698648871447 2023-10-30 06:54:32,373 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698648871447 2023-10-30 06:54:32,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1698648871447 2023-10-30 06:54:32,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1698648871447 2023-10-30 06:54:32,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698648871447 2023-10-30 06:54:32,373 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-30 06:54:32,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:32,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-30 06:54:32,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-30 06:54:32,374 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1698648871447/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:32,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-30 06:54:32,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:32,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698648871447 2023-10-30 06:54:32,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698648871447 2023-10-30 06:54:32,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:32,374 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1698648871447/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:32,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698648871447 2023-10-30 06:54:32,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:32,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:32,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698648871447 2023-10-30 06:54:32,376 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698648871447/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:32,376 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698648871447 2023-10-30 06:54:32,376 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698648871447 2023-10-30 06:54:32,376 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:32,376 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-30 06:54:32,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1698648871447 2023-10-30 06:54:32,376 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698648871447/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:32,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-30 06:54:32,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-10-30 06:54:32,376 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-30 06:54:32,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-30 06:54:32,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1698648871447 2023-10-30 06:54:32,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1698648871447 because node does not exist (not an error) 2023-10-30 06:54:32,376 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698648871447 2023-10-30 06:54:32,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-30 06:54:32,376 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698648871447 2023-10-30 06:54:32,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-30 06:54:32,376 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698648871447 2023-10-30 06:54:32,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-30 06:54:32,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030021113c107314bdf8c0b47d024258ba4, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310303a5284afcab8411081ce6613ef912e22, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305edcfbddcf684a71835737c85f5bd817, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030f7f635e224be4126ba2ba1be9fcf3e5a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310303fceef27fc2d4879992154582c6d8bab, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310305dbea680af974ad09bf5c3e588e97cb9, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030a59c36962fd24b01ae640827bf734827, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ff860f014ef44e1087112c5907e73e42, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310300f8da9cf0fb940a5818d169aa3781714, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030ad5a576fe6a347fa83c01cded63f3d5a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030d9eea4afc2d84573bb823800ab8f4715, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030dc210fd1a1134fa3bef38f932b251031] mob files 2023-10-30 06:54:32,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030021113c107314bdf8c0b47d024258ba4 2023-10-30 06:54:32,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310303a5284afcab8411081ce6613ef912e22 2023-10-30 06:54:32,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305edcfbddcf684a71835737c85f5bd817 2023-10-30 06:54:32,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030f7f635e224be4126ba2ba1be9fcf3e5a 2023-10-30 06:54:32,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310303fceef27fc2d4879992154582c6d8bab 2023-10-30 06:54:32,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310305dbea680af974ad09bf5c3e588e97cb9 2023-10-30 06:54:32,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030a59c36962fd24b01ae640827bf734827 2023-10-30 06:54:32,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ff860f014ef44e1087112c5907e73e42 2023-10-30 06:54:32,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310300f8da9cf0fb940a5818d169aa3781714 2023-10-30 06:54:32,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030ad5a576fe6a347fa83c01cded63f3d5a 2023-10-30 06:54:32,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030d9eea4afc2d84573bb823800ab8f4715 2023-10-30 06:54:32,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030dc210fd1a1134fa3bef38f932b251031 2023-10-30 06:54:32,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030458075cd4ece432fa89db1a3aad8b026, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030d1860b52464b42c39fd00d4ed9a3c346, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030db1bf67698e7468c8b6b4bb85f5a8179, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030f1414fcead4c4e1ebaca22d0f411a50b, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103006b9b664c5514c9fa1153865383cdf81, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e201ac04e37d48f3ae323cedfd079f7c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e6c55353907d47c99ad7c3702a2369a7, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e828ace505c74030bfecc47a9f5ab8da, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103040541d6f6b0f4a7d885d9da46483911b, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103045cf442326eb466d84c3301d31c8c3f7, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103065452d661ff749ed9f7b90ecbdd8a845, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030c15b5113113243c4b0bdaf6f027e2b48] mob files 2023-10-30 06:54:32,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030458075cd4ece432fa89db1a3aad8b026 2023-10-30 06:54:32,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030d1860b52464b42c39fd00d4ed9a3c346 2023-10-30 06:54:32,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030db1bf67698e7468c8b6b4bb85f5a8179 2023-10-30 06:54:32,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030f1414fcead4c4e1ebaca22d0f411a50b 2023-10-30 06:54:32,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103006b9b664c5514c9fa1153865383cdf81 2023-10-30 06:54:32,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e201ac04e37d48f3ae323cedfd079f7c 2023-10-30 06:54:32,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e6c55353907d47c99ad7c3702a2369a7 2023-10-30 06:54:32,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e828ace505c74030bfecc47a9f5ab8da 2023-10-30 06:54:32,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103040541d6f6b0f4a7d885d9da46483911b 2023-10-30 06:54:32,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103045cf442326eb466d84c3301d31c8c3f7 2023-10-30 06:54:32,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103065452d661ff749ed9f7b90ecbdd8a845 2023-10-30 06:54:32,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030c15b5113113243c4b0bdaf6f027e2b48 2023-10-30 06:54:32,614 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 06:54:32,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 06:54:32,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 06:54:32,617 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-30 06:54:32,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1698648871447 2023-10-30 06:54:32,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot/.tmp/snaptb-1698648871447 2023-10-30 06:54:33,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot/.tmp/snaptb-1698648871447 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot/snaptb-1698648871447 2023-10-30 06:54:33,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1698648871447 of table testCompactionWithHFileLink completed 2023-10-30 06:54:33,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot/.tmp/snaptb-1698648871447 2023-10-30 06:54:33,248 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot/.tmp/snaptb-1698648871447 2023-10-30 06:54:33,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1698648871447 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698648871499Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1698648872786 (+1287 ms)Consolidate snapshot: snaptb-1698648871447 at 1698648872786Loading Region manifests for snaptb-1698648871447 at 1698648872787 (+1 ms)Writing data manifest for snaptb-1698648871447 at 1698648872804 (+17 ms)Verifying snapshot: snaptb-1698648871447 at 1698648873215 (+411 ms)Snapshot snaptb-1698648871447 of table testCompactionWithHFileLink completed at 1698648873247 (+32 ms) 2023-10-30 06:54:33,249 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-30 06:54:33,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.7480 sec 2023-10-30 06:54:33,617 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 06:54:33,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 06:54:33,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-30 06:54:33,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:33,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:33,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 06:54:33,669 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 06:54:33,669 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:33,669 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 06:54:33,670 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 06:54:33,670 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:33,670 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:33,671 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:33,671 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:33,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:33,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:33,672 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:33,672 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:33,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:33,673 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 06:54:33,673 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-30 06:54:33,673 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 06:54:33,673 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 06:54:33,673 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:33,673 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 06:54:33,674 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:33,674 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:54:33,674 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:33,674 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. started... 2023-10-30 06:54:33,674 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:33,674 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. started... 2023-10-30 06:54:33,674 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:33,674 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 570b991da0936dd868ef50ca1259021d 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 06:54:33,674 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fd2fe0ed654295f84d64a2166ce6f05f 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 06:54:33,674 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. started... 2023-10-30 06:54:33,674 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f040c33a0574cbb9f453444bee0294f2 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 06:54:34,501 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family1/6434e75b169c44869c2ff05555fdaa87 2023-10-30 06:54:34,502 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family1/a213808527de4bf1a05bc97dc2ca9b4d 2023-10-30 06:54:34,503 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family1/1ed17b1d0304467cbdc38233627e2e2e 2023-10-30 06:54:34,510 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6434e75b169c44869c2ff05555fdaa87 2023-10-30 06:54:34,511 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a213808527de4bf1a05bc97dc2ca9b4d 2023-10-30 06:54:34,511 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ed17b1d0304467cbdc38233627e2e2e 2023-10-30 06:54:35,329 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family2/8216fe0470c2490f9e99dd0f6e569c99 2023-10-30 06:54:35,332 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family2/81b7cce9c0fd43e4938ac2ae6f88b123 2023-10-30 06:54:35,334 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family2/e754e73ff2264f808499108471cb08a4 2023-10-30 06:54:35,335 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8216fe0470c2490f9e99dd0f6e569c99 2023-10-30 06:54:35,335 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family1/6434e75b169c44869c2ff05555fdaa87 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/6434e75b169c44869c2ff05555fdaa87 2023-10-30 06:54:35,337 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81b7cce9c0fd43e4938ac2ae6f88b123 2023-10-30 06:54:35,338 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family1/1ed17b1d0304467cbdc38233627e2e2e as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/1ed17b1d0304467cbdc38233627e2e2e 2023-10-30 06:54:35,342 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6434e75b169c44869c2ff05555fdaa87 2023-10-30 06:54:35,342 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/6434e75b169c44869c2ff05555fdaa87, entries=3, sequenceid=24, filesize=5.0 K 2023-10-30 06:54:35,343 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e754e73ff2264f808499108471cb08a4 2023-10-30 06:54:35,344 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family2/8216fe0470c2490f9e99dd0f6e569c99 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/8216fe0470c2490f9e99dd0f6e569c99 2023-10-30 06:54:35,344 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ed17b1d0304467cbdc38233627e2e2e 2023-10-30 06:54:35,344 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family1/a213808527de4bf1a05bc97dc2ca9b4d as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/a213808527de4bf1a05bc97dc2ca9b4d 2023-10-30 06:54:35,344 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/1ed17b1d0304467cbdc38233627e2e2e, entries=3, sequenceid=24, filesize=5.0 K 2023-10-30 06:54:35,345 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family2/81b7cce9c0fd43e4938ac2ae6f88b123 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/81b7cce9c0fd43e4938ac2ae6f88b123 2023-10-30 06:54:35,349 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a213808527de4bf1a05bc97dc2ca9b4d 2023-10-30 06:54:35,349 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/a213808527de4bf1a05bc97dc2ca9b4d, entries=3, sequenceid=24, filesize=5.0 K 2023-10-30 06:54:35,351 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family2/e754e73ff2264f808499108471cb08a4 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/e754e73ff2264f808499108471cb08a4 2023-10-30 06:54:35,360 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8216fe0470c2490f9e99dd0f6e569c99 2023-10-30 06:54:35,360 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/8216fe0470c2490f9e99dd0f6e569c99, entries=1, sequenceid=24, filesize=5.0 K 2023-10-30 06:54:35,361 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 570b991da0936dd868ef50ca1259021d in 1687ms, sequenceid=24, compaction requested=true 2023-10-30 06:54:35,361 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:35,361 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:35,361 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:54:35,366 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81b7cce9c0fd43e4938ac2ae6f88b123 2023-10-30 06:54:35,366 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/81b7cce9c0fd43e4938ac2ae6f88b123, entries=1, sequenceid=24, filesize=5.0 K 2023-10-30 06:54:35,367 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f040c33a0574cbb9f453444bee0294f2 in 1693ms, sequenceid=24, compaction requested=true 2023-10-30 06:54:35,367 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:35,368 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:35,368 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:54:35,368 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e754e73ff2264f808499108471cb08a4 2023-10-30 06:54:35,368 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/e754e73ff2264f808499108471cb08a4, entries=1, sequenceid=24, filesize=5.0 K 2023-10-30 06:54:35,369 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for fd2fe0ed654295f84d64a2166ce6f05f in 1695ms, sequenceid=24, compaction requested=true 2023-10-30 06:54:35,370 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:35,370 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:35,370 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:54:35,370 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:54:35,370 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:35,370 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 06:54:35,370 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 06:54:35,372 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:35,372 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:35,373 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:35,373 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:35,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:35,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:35,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:35,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 06:54:35,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ee73aa[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:35,374 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 06:54:35,374 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:35,375 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:35,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:35,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:35,375 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 06:54:35,375 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 06:54:35,375 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:35,375 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:35,375 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:35,376 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 06:54:35,376 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:35,376 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:35,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:35,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:35,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:35,376 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 06:54:35,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:35,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:35,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:35,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:35,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:35,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:35,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:35,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:35,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 06:54:35,379 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 06:54:35,379 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:35,379 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:35,379 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 06:54:35,379 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:35,380 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:35,380 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:35,380 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:35,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:35,380 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:35,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:35,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:35,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:35,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:35,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:35,382 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:35,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 06:54:35,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:35,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:35,383 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:35,383 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:35,383 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 06:54:35,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 06:54:35,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:35,383 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:35,383 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:35,383 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:35,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:35,384 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:35,384 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-30 06:54:35,384 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:35,384 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:35,384 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:35,384 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 06:54:35,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:35,384 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 06:54:35,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:35,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:35,484 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:35,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:35,486 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:54:35,486 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): fd2fe0ed654295f84d64a2166ce6f05f/family1 is initiating major compaction (all files) 2023-10-30 06:54:35,486 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:54:35,486 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:54:35,486 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of fd2fe0ed654295f84d64a2166ce6f05f/family1 in testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:35,486 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/dc3f481d4da4462b8763896c8e74cbda, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/0133c3bcd7234223b3f1953aa36bf981, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/40770f8b14244f33ab8455fefea8d2ef, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/e9293e91bcc441c3bb7ecbf6ae816e8c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/a213808527de4bf1a05bc97dc2ca9b4d] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp, totalSize=26.7 K 2023-10-30 06:54:35,487 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting dc3f481d4da4462b8763896c8e74cbda, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648864028 2023-10-30 06:54:35,488 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 0133c3bcd7234223b3f1953aa36bf981, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648865841 2023-10-30 06:54:35,488 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 40770f8b14244f33ab8455fefea8d2ef, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648867673 2023-10-30 06:54:35,489 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting e9293e91bcc441c3bb7ecbf6ae816e8c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648869619 2023-10-30 06:54:35,489 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting a213808527de4bf1a05bc97dc2ca9b4d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 06:54:35,525 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): fd2fe0ed654295f84d64a2166ce6f05f#family1#compaction#107 average throughput is 0.16 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:54:35,943 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231030e5f24c6995b5458e80aff9dbf02f5e47_del 2023-10-30 06:54:35,943 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030e5f24c6995b5458e80aff9dbf02f5e47_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030e5f24c6995b5458e80aff9dbf02f5e47_del 2023-10-30 06:54:36,769 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b729a4bf39014790b8b78bd140208e4b 2023-10-30 06:54:36,770 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family1/b729a4bf39014790b8b78bd140208e4b as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/b729a4bf39014790b8b78bd140208e4b 2023-10-30 06:54:36,775 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b729a4bf39014790b8b78bd140208e4b 2023-10-30 06:54:36,776 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fd2fe0ed654295f84d64a2166ce6f05f/family1 of fd2fe0ed654295f84d64a2166ce6f05f into b729a4bf39014790b8b78bd140208e4b(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:54:36,776 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:36,776 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:54:36,776 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): fd2fe0ed654295f84d64a2166ce6f05f/family2 is initiating major compaction (all files) 2023-10-30 06:54:36,777 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:54:36,777 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:54:36,777 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of fd2fe0ed654295f84d64a2166ce6f05f/family2 in testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:36,777 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/fca7c332984945bc80b348cc51442c60, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/ab029fd919ee4a8789fc32de37bafa2c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/618962d22cca49e5b9a996d4747b7f1f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/d6922695a3a84331b7d8e02c3b7aa2cb, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/e754e73ff2264f808499108471cb08a4] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp, totalSize=25.4 K 2023-10-30 06:54:36,777 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting fca7c332984945bc80b348cc51442c60, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648864028 2023-10-30 06:54:36,778 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting ab029fd919ee4a8789fc32de37bafa2c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648865841 2023-10-30 06:54:36,778 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 618962d22cca49e5b9a996d4747b7f1f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648867673 2023-10-30 06:54:36,779 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting d6922695a3a84331b7d8e02c3b7aa2cb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648869619 2023-10-30 06:54:36,779 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting e754e73ff2264f808499108471cb08a4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 06:54:36,799 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): fd2fe0ed654295f84d64a2166ce6f05f#family2#compaction#108 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:54:36,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/dc3f481d4da4462b8763896c8e74cbda, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/0133c3bcd7234223b3f1953aa36bf981, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/40770f8b14244f33ab8455fefea8d2ef, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/e9293e91bcc441c3bb7ecbf6ae816e8c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/a213808527de4bf1a05bc97dc2ca9b4d] to archive 2023-10-30 06:54:36,812 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:36,814 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/dc3f481d4da4462b8763896c8e74cbda to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/dc3f481d4da4462b8763896c8e74cbda 2023-10-30 06:54:36,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/0133c3bcd7234223b3f1953aa36bf981 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/0133c3bcd7234223b3f1953aa36bf981 2023-10-30 06:54:36,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/40770f8b14244f33ab8455fefea8d2ef to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/40770f8b14244f33ab8455fefea8d2ef 2023-10-30 06:54:36,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/e9293e91bcc441c3bb7ecbf6ae816e8c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/e9293e91bcc441c3bb7ecbf6ae816e8c 2023-10-30 06:54:36,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/a213808527de4bf1a05bc97dc2ca9b4d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/a213808527de4bf1a05bc97dc2ca9b4d 2023-10-30 06:54:37,212 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310307f5d717dc8e848fc9b8fcce1da9b4d5a_del 2023-10-30 06:54:37,212 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310307f5d717dc8e848fc9b8fcce1da9b4d5a_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310307f5d717dc8e848fc9b8fcce1da9b4d5a_del 2023-10-30 06:54:37,631 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0bc08403a06a4be985027147f9ee6f8b 2023-10-30 06:54:37,632 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family2/0bc08403a06a4be985027147f9ee6f8b as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/0bc08403a06a4be985027147f9ee6f8b 2023-10-30 06:54:37,635 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0bc08403a06a4be985027147f9ee6f8b 2023-10-30 06:54:37,636 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fd2fe0ed654295f84d64a2166ce6f05f/family2 of fd2fe0ed654295f84d64a2166ce6f05f into 0bc08403a06a4be985027147f9ee6f8b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:54:37,636 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:37,636 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:54:37,637 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): 570b991da0936dd868ef50ca1259021d/family1 is initiating major compaction (all files) 2023-10-30 06:54:37,637 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:54:37,637 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:54:37,637 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of 570b991da0936dd868ef50ca1259021d/family1 in testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:37,637 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/b95281a1720c482b9ec17a02a87d6b65, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/7f09297a98814e8fb694af5775f3ab6a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d8eed4b92a704b0792b454c0e5bbae8a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d952b53beec64936896c3e5e46d2c1e8, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/6434e75b169c44869c2ff05555fdaa87] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp, totalSize=26.7 K 2023-10-30 06:54:37,637 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting b95281a1720c482b9ec17a02a87d6b65, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648864029 2023-10-30 06:54:37,638 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 7f09297a98814e8fb694af5775f3ab6a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648865841 2023-10-30 06:54:37,638 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting d8eed4b92a704b0792b454c0e5bbae8a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648867674 2023-10-30 06:54:37,638 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting d952b53beec64936896c3e5e46d2c1e8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648869621 2023-10-30 06:54:37,638 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 6434e75b169c44869c2ff05555fdaa87, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 06:54:37,649 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): 570b991da0936dd868ef50ca1259021d#family1#compaction#109 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:54:37,713 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/fca7c332984945bc80b348cc51442c60, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/ab029fd919ee4a8789fc32de37bafa2c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/618962d22cca49e5b9a996d4747b7f1f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/d6922695a3a84331b7d8e02c3b7aa2cb, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/e754e73ff2264f808499108471cb08a4] to archive 2023-10-30 06:54:37,714 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:37,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/fca7c332984945bc80b348cc51442c60 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/fca7c332984945bc80b348cc51442c60 2023-10-30 06:54:37,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/ab029fd919ee4a8789fc32de37bafa2c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/ab029fd919ee4a8789fc32de37bafa2c 2023-10-30 06:54:37,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/618962d22cca49e5b9a996d4747b7f1f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/618962d22cca49e5b9a996d4747b7f1f 2023-10-30 06:54:37,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/d6922695a3a84331b7d8e02c3b7aa2cb to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/d6922695a3a84331b7d8e02c3b7aa2cb 2023-10-30 06:54:37,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/e754e73ff2264f808499108471cb08a4 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/e754e73ff2264f808499108471cb08a4 2023-10-30 06:54:38,057 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310307b1f8621ccf84aadbc5321a3e8c9ea6c_del 2023-10-30 06:54:38,057 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310307b1f8621ccf84aadbc5321a3e8c9ea6c_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310307b1f8621ccf84aadbc5321a3e8c9ea6c_del 2023-10-30 06:54:38,482 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10b80024f88348fdac2479efd2bd3185 2023-10-30 06:54:38,484 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family1/10b80024f88348fdac2479efd2bd3185 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/10b80024f88348fdac2479efd2bd3185 2023-10-30 06:54:38,492 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10b80024f88348fdac2479efd2bd3185 2023-10-30 06:54:38,493 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 570b991da0936dd868ef50ca1259021d/family1 of 570b991da0936dd868ef50ca1259021d into 10b80024f88348fdac2479efd2bd3185(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:54:38,493 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:38,493 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:54:38,493 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): 570b991da0936dd868ef50ca1259021d/family2 is initiating major compaction (all files) 2023-10-30 06:54:38,494 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:54:38,494 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:54:38,494 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of 570b991da0936dd868ef50ca1259021d/family2 in testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:38,494 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/19947e0cbcef4f759642e84ac7b612ca, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/fd4594129f1249819d49581025e122ab, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/0504fd6f8ad2495d8fbf2f3069916bbf, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/99125cfc1c274a58b5463561f1bd5ea2, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/8216fe0470c2490f9e99dd0f6e569c99] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp, totalSize=25.4 K 2023-10-30 06:54:38,495 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 19947e0cbcef4f759642e84ac7b612ca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648864029 2023-10-30 06:54:38,496 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting fd4594129f1249819d49581025e122ab, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648865841 2023-10-30 06:54:38,496 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 0504fd6f8ad2495d8fbf2f3069916bbf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648867674 2023-10-30 06:54:38,497 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 99125cfc1c274a58b5463561f1bd5ea2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648869621 2023-10-30 06:54:38,498 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 8216fe0470c2490f9e99dd0f6e569c99, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 06:54:38,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/b95281a1720c482b9ec17a02a87d6b65, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/7f09297a98814e8fb694af5775f3ab6a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d8eed4b92a704b0792b454c0e5bbae8a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d952b53beec64936896c3e5e46d2c1e8, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/6434e75b169c44869c2ff05555fdaa87] to archive 2023-10-30 06:54:38,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:38,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/b95281a1720c482b9ec17a02a87d6b65 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/b95281a1720c482b9ec17a02a87d6b65 2023-10-30 06:54:38,514 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): 570b991da0936dd868ef50ca1259021d#family2#compaction#110 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:54:38,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/7f09297a98814e8fb694af5775f3ab6a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/7f09297a98814e8fb694af5775f3ab6a 2023-10-30 06:54:38,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d8eed4b92a704b0792b454c0e5bbae8a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d8eed4b92a704b0792b454c0e5bbae8a 2023-10-30 06:54:38,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d952b53beec64936896c3e5e46d2c1e8 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/d952b53beec64936896c3e5e46d2c1e8 2023-10-30 06:54:38,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/6434e75b169c44869c2ff05555fdaa87 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/6434e75b169c44869c2ff05555fdaa87 2023-10-30 06:54:38,526 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023103093939ba7444a472aab5d00eaac307099_del 2023-10-30 06:54:38,526 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103093939ba7444a472aab5d00eaac307099_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103093939ba7444a472aab5d00eaac307099_del 2023-10-30 06:54:39,361 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for adc329bf9dfc46b1af0ab167a40af97f 2023-10-30 06:54:39,362 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family2/adc329bf9dfc46b1af0ab167a40af97f as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/adc329bf9dfc46b1af0ab167a40af97f 2023-10-30 06:54:39,368 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for adc329bf9dfc46b1af0ab167a40af97f 2023-10-30 06:54:39,369 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 570b991da0936dd868ef50ca1259021d/family2 of 570b991da0936dd868ef50ca1259021d into adc329bf9dfc46b1af0ab167a40af97f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:54:39,369 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:39,370 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:54:39,370 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): f040c33a0574cbb9f453444bee0294f2/family1 is initiating major compaction (all files) 2023-10-30 06:54:39,370 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:54:39,370 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:54:39,371 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of f040c33a0574cbb9f453444bee0294f2/family1 in testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:39,371 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a41eae486c58411297cc1080d02cc7f6, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2d93a80180a04d768aad4a10056d9f3d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a981bc4dceb146cdaedd5eabb59ba867, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/833c20f5c1334866b4f63be6e638fcd8, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/1ed17b1d0304467cbdc38233627e2e2e] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp, totalSize=26.7 K 2023-10-30 06:54:39,371 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting a41eae486c58411297cc1080d02cc7f6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648864029 2023-10-30 06:54:39,372 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 2d93a80180a04d768aad4a10056d9f3d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648865842 2023-10-30 06:54:39,372 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting a981bc4dceb146cdaedd5eabb59ba867, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648867674 2023-10-30 06:54:39,373 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 833c20f5c1334866b4f63be6e638fcd8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648869621 2023-10-30 06:54:39,373 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 1ed17b1d0304467cbdc38233627e2e2e, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 06:54:39,391 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): f040c33a0574cbb9f453444bee0294f2#family1#compaction#111 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:54:39,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/19947e0cbcef4f759642e84ac7b612ca, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/fd4594129f1249819d49581025e122ab, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/0504fd6f8ad2495d8fbf2f3069916bbf, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/99125cfc1c274a58b5463561f1bd5ea2, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/8216fe0470c2490f9e99dd0f6e569c99] to archive 2023-10-30 06:54:39,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:39,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/19947e0cbcef4f759642e84ac7b612ca to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/19947e0cbcef4f759642e84ac7b612ca 2023-10-30 06:54:39,413 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/fd4594129f1249819d49581025e122ab to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/fd4594129f1249819d49581025e122ab 2023-10-30 06:54:39,414 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/0504fd6f8ad2495d8fbf2f3069916bbf to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/0504fd6f8ad2495d8fbf2f3069916bbf 2023-10-30 06:54:39,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/99125cfc1c274a58b5463561f1bd5ea2 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/99125cfc1c274a58b5463561f1bd5ea2 2023-10-30 06:54:39,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/8216fe0470c2490f9e99dd0f6e569c99 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/8216fe0470c2490f9e99dd0f6e569c99 2023-10-30 06:54:39,812 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231030d2bd4b766c7042ce87497f2b58340505_del 2023-10-30 06:54:39,813 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030d2bd4b766c7042ce87497f2b58340505_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030d2bd4b766c7042ce87497f2b58340505_del 2023-10-30 06:54:40,645 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87be04d6a4084237ad1cb921bbeb74bf 2023-10-30 06:54:40,647 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family1/87be04d6a4084237ad1cb921bbeb74bf as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/87be04d6a4084237ad1cb921bbeb74bf 2023-10-30 06:54:40,653 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87be04d6a4084237ad1cb921bbeb74bf 2023-10-30 06:54:40,654 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f040c33a0574cbb9f453444bee0294f2/family1 of f040c33a0574cbb9f453444bee0294f2 into 87be04d6a4084237ad1cb921bbeb74bf(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:54:40,654 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:40,654 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:54:40,654 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): f040c33a0574cbb9f453444bee0294f2/family2 is initiating major compaction (all files) 2023-10-30 06:54:40,655 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:54:40,655 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:54:40,655 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of f040c33a0574cbb9f453444bee0294f2/family2 in testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:40,655 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/4c3c36b07c38401baf150fc472fcdae5, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/de8c6da443c44db4962a4fe779a42cb7, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/e630c91fb8df4e43aff22d715e18a0af, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/56fe2f93c1894199acc149c0f92b364a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/81b7cce9c0fd43e4938ac2ae6f88b123] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp, totalSize=25.4 K 2023-10-30 06:54:40,655 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 4c3c36b07c38401baf150fc472fcdae5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648864029 2023-10-30 06:54:40,656 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting de8c6da443c44db4962a4fe779a42cb7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648865842 2023-10-30 06:54:40,656 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting e630c91fb8df4e43aff22d715e18a0af, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648867674 2023-10-30 06:54:40,657 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 56fe2f93c1894199acc149c0f92b364a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648869621 2023-10-30 06:54:40,657 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 81b7cce9c0fd43e4938ac2ae6f88b123, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 06:54:40,670 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): f040c33a0574cbb9f453444bee0294f2#family2#compaction#112 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:54:40,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a41eae486c58411297cc1080d02cc7f6, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2d93a80180a04d768aad4a10056d9f3d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a981bc4dceb146cdaedd5eabb59ba867, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/833c20f5c1334866b4f63be6e638fcd8, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/1ed17b1d0304467cbdc38233627e2e2e] to archive 2023-10-30 06:54:40,711 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:40,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a41eae486c58411297cc1080d02cc7f6 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a41eae486c58411297cc1080d02cc7f6 2023-10-30 06:54:40,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2d93a80180a04d768aad4a10056d9f3d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2d93a80180a04d768aad4a10056d9f3d 2023-10-30 06:54:40,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a981bc4dceb146cdaedd5eabb59ba867 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/a981bc4dceb146cdaedd5eabb59ba867 2023-10-30 06:54:40,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/833c20f5c1334866b4f63be6e638fcd8 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/833c20f5c1334866b4f63be6e638fcd8 2023-10-30 06:54:40,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/1ed17b1d0304467cbdc38233627e2e2e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/1ed17b1d0304467cbdc38233627e2e2e 2023-10-30 06:54:41,086 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023103097e53b87e5f34f248e15963f74ef273b_del 2023-10-30 06:54:41,086 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103097e53b87e5f34f248e15963f74ef273b_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103097e53b87e5f34f248e15963f74ef273b_del 2023-10-30 06:54:41,915 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4bf97b85160344bebfdb3ecb9a6d84ab 2023-10-30 06:54:41,916 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family2/4bf97b85160344bebfdb3ecb9a6d84ab as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/4bf97b85160344bebfdb3ecb9a6d84ab 2023-10-30 06:54:41,920 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4bf97b85160344bebfdb3ecb9a6d84ab 2023-10-30 06:54:41,921 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f040c33a0574cbb9f453444bee0294f2/family2 of f040c33a0574cbb9f453444bee0294f2 into 4bf97b85160344bebfdb3ecb9a6d84ab(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:54:41,921 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:41,927 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:54:41,933 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:54:41,941 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:54:41,943 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:54:41,950 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 06:54:41,985 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-10-30 06:54:41,988 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231030e5f24c6995b5458e80aff9dbf02f5e47_del 2023-10-30 06:54:41,990 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310307b1f8621ccf84aadbc5321a3e8c9ea6c_del 2023-10-30 06:54:41,993 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231030d2bd4b766c7042ce87497f2b58340505_del 2023-10-30 06:54:41,993 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:41,994 DEBUG [Listener at localhost/40811] zookeeper.ReadOnlyZKClient(139): Connect 0x7c5f3021 to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:54:41,997 DEBUG [Listener at localhost/40811] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b0db9e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:54:41,997 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 06:54:41,998 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 06:54:41,998 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 06:54:42,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/4c3c36b07c38401baf150fc472fcdae5, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/de8c6da443c44db4962a4fe779a42cb7, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/e630c91fb8df4e43aff22d715e18a0af, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/56fe2f93c1894199acc149c0f92b364a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/81b7cce9c0fd43e4938ac2ae6f88b123] to archive 2023-10-30 06:54:42,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:42,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/4c3c36b07c38401baf150fc472fcdae5 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/4c3c36b07c38401baf150fc472fcdae5 2023-10-30 06:54:42,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/de8c6da443c44db4962a4fe779a42cb7 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/de8c6da443c44db4962a4fe779a42cb7 2023-10-30 06:54:42,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/e630c91fb8df4e43aff22d715e18a0af to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/e630c91fb8df4e43aff22d715e18a0af 2023-10-30 06:54:42,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/56fe2f93c1894199acc149c0f92b364a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/56fe2f93c1894199acc149c0f92b364a 2023-10-30 06:54:42,016 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/81b7cce9c0fd43e4938ac2ae6f88b123 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/81b7cce9c0fd43e4938ac2ae6f88b123 2023-10-30 06:54:42,468 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103030f80c21903443ef92985fb9d0557190 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103030f80c21903443ef92985fb9d0557190 2023-10-30 06:54:42,468 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:42,469 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030843e44dde25a4683807a4539ebec5674 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030843e44dde25a4683807a4539ebec5674 2023-10-30 06:54:42,470 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:42,471 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310306eb59c9d7c5a485fb827959e49bc9703 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310306eb59c9d7c5a485fb827959e49bc9703 2023-10-30 06:54:42,472 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:42,483 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:54:42,486 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:54:42,492 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:54:42,494 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:54:42,506 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/a113600da86c4064977f0480907f5302 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-10-30 06:54:42,506 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/74b27e18e9104d72951a3f35f92cbdd2 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-10-30 06:54:42,506 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/d57c5896e44349cdb36b8fdeec3eb0b0 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-10-30 06:54:42,509 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/74b27e18e9104d72951a3f35f92cbdd2}] 2023-10-30 06:54:42,509 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/d57c5896e44349cdb36b8fdeec3eb0b0}] 2023-10-30 06:54:42,509 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/a113600da86c4064977f0480907f5302}] 2023-10-30 06:54:42,514 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/a113600da86c4064977f0480907f5302 for inclusion in f040c33a0574cbb9f453444bee0294f2/family1 2023-10-30 06:54:42,514 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/d57c5896e44349cdb36b8fdeec3eb0b0 for inclusion in fd2fe0ed654295f84d64a2166ce6f05f/family1 2023-10-30 06:54:42,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/74b27e18e9104d72951a3f35f92cbdd2 for inclusion in 570b991da0936dd868ef50ca1259021d/family1 2023-10-30 06:54:42,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-10-30 06:54:42,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-10-30 06:54:42,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-10-30 06:54:42,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 06:54:42,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-30 06:54:42,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last=1 2023-10-30 06:54:42,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:42,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:42,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:42,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/a113600da86c4064977f0480907f5302 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__vumf3161rjlq9l4bn2ugdj22jsms56ih5kuvj5fh0vt57c0h011qn5okbc0tsvfk/family1/a113600da86c4064977f0480907f5302 2023-10-30 06:54:42,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/74b27e18e9104d72951a3f35f92cbdd2 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__95dmielq3tlqbm1ov8ichjce6k2fj96cffub1npqp9a11bpmlpjlmd3enuh618pj/family1/74b27e18e9104d72951a3f35f92cbdd2 2023-10-30 06:54:42,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/d57c5896e44349cdb36b8fdeec3eb0b0 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__amjph4k4iri28vo6g9e8557796cm46v1d5mhdjpg09itdehle6o4sj2rk1psi5ip/family1/d57c5896e44349cdb36b8fdeec3eb0b0 2023-10-30 06:54:42,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__vumf3161rjlq9l4bn2ugdj22jsms56ih5kuvj5fh0vt57c0h011qn5okbc0tsvfk/family1/a113600da86c4064977f0480907f5302 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2675673e212d46deaf7e785d05024245_SeqId_29_ 2023-10-30 06:54:42,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__amjph4k4iri28vo6g9e8557796cm46v1d5mhdjpg09itdehle6o4sj2rk1psi5ip/family1/d57c5896e44349cdb36b8fdeec3eb0b0 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/5d9b695745cc48a98b61a2eb3f7a4508_SeqId_29_ 2023-10-30 06:54:42,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__95dmielq3tlqbm1ov8ichjce6k2fj96cffub1npqp9a11bpmlpjlmd3enuh618pj/family1/74b27e18e9104d72951a3f35f92cbdd2 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/f9654aace8004b5da2a1a3f7960dcbd5_SeqId_29_ 2023-10-30 06:54:42,523 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__vumf3161rjlq9l4bn2ugdj22jsms56ih5kuvj5fh0vt57c0h011qn5okbc0tsvfk/family1/a113600da86c4064977f0480907f5302 into f040c33a0574cbb9f453444bee0294f2/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2675673e212d46deaf7e785d05024245_SeqId_29_ - updating store file list. 2023-10-30 06:54:42,523 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__amjph4k4iri28vo6g9e8557796cm46v1d5mhdjpg09itdehle6o4sj2rk1psi5ip/family1/d57c5896e44349cdb36b8fdeec3eb0b0 into fd2fe0ed654295f84d64a2166ce6f05f/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/5d9b695745cc48a98b61a2eb3f7a4508_SeqId_29_ - updating store file list. 2023-10-30 06:54:42,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__95dmielq3tlqbm1ov8ichjce6k2fj96cffub1npqp9a11bpmlpjlmd3enuh618pj/family1/74b27e18e9104d72951a3f35f92cbdd2 into 570b991da0936dd868ef50ca1259021d/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/f9654aace8004b5da2a1a3f7960dcbd5_SeqId_29_ - updating store file list. 2023-10-30 06:54:42,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/f9654aace8004b5da2a1a3f7960dcbd5_SeqId_29_ into 570b991da0936dd868ef50ca1259021d/family1 2023-10-30 06:54:42,527 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2675673e212d46deaf7e785d05024245_SeqId_29_ into f040c33a0574cbb9f453444bee0294f2/family1 2023-10-30 06:54:42,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__95dmielq3tlqbm1ov8ichjce6k2fj96cffub1npqp9a11bpmlpjlmd3enuh618pj/family1/74b27e18e9104d72951a3f35f92cbdd2 into 570b991da0936dd868ef50ca1259021d/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/f9654aace8004b5da2a1a3f7960dcbd5_SeqId_29_) 2023-10-30 06:54:42,526 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/5d9b695745cc48a98b61a2eb3f7a4508_SeqId_29_ into fd2fe0ed654295f84d64a2166ce6f05f/family1 2023-10-30 06:54:42,527 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__amjph4k4iri28vo6g9e8557796cm46v1d5mhdjpg09itdehle6o4sj2rk1psi5ip/family1/d57c5896e44349cdb36b8fdeec3eb0b0 into fd2fe0ed654295f84d64a2166ce6f05f/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/5d9b695745cc48a98b61a2eb3f7a4508_SeqId_29_) 2023-10-30 06:54:42,527 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__vumf3161rjlq9l4bn2ugdj22jsms56ih5kuvj5fh0vt57c0h011qn5okbc0tsvfk/family1/a113600da86c4064977f0480907f5302 into f040c33a0574cbb9f453444bee0294f2/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2675673e212d46deaf7e785d05024245_SeqId_29_) 2023-10-30 06:54:42,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__95dmielq3tlqbm1ov8ichjce6k2fj96cffub1npqp9a11bpmlpjlmd3enuh618pj/family1/74b27e18e9104d72951a3f35f92cbdd2 2023-10-30 06:54:42,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__amjph4k4iri28vo6g9e8557796cm46v1d5mhdjpg09itdehle6o4sj2rk1psi5ip/family1/d57c5896e44349cdb36b8fdeec3eb0b0 2023-10-30 06:54:42,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__vumf3161rjlq9l4bn2ugdj22jsms56ih5kuvj5fh0vt57c0h011qn5okbc0tsvfk/family1/a113600da86c4064977f0480907f5302 2023-10-30 06:54:42,529 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:42,529 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:42,529 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:42,530 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:42,530 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:42,530 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:42,531 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030021113c107314bdf8c0b47d024258ba4 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030021113c107314bdf8c0b47d024258ba4 2023-10-30 06:54:42,532 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310303fceef27fc2d4879992154582c6d8bab to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310303fceef27fc2d4879992154582c6d8bab 2023-10-30 06:54:42,532 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310300f8da9cf0fb940a5818d169aa3781714 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310300f8da9cf0fb940a5818d169aa3781714 2023-10-30 06:54:42,532 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310303a5284afcab8411081ce6613ef912e22 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310303a5284afcab8411081ce6613ef912e22 2023-10-30 06:54:42,533 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310305dbea680af974ad09bf5c3e588e97cb9 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310305dbea680af974ad09bf5c3e588e97cb9 2023-10-30 06:54:42,533 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030ad5a576fe6a347fa83c01cded63f3d5a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030ad5a576fe6a347fa83c01cded63f3d5a 2023-10-30 06:54:42,534 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305edcfbddcf684a71835737c85f5bd817 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310305edcfbddcf684a71835737c85f5bd817 2023-10-30 06:54:42,534 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030a59c36962fd24b01ae640827bf734827 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030a59c36962fd24b01ae640827bf734827 2023-10-30 06:54:42,534 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030d9eea4afc2d84573bb823800ab8f4715 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030d9eea4afc2d84573bb823800ab8f4715 2023-10-30 06:54:42,534 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030f7f635e224be4126ba2ba1be9fcf3e5a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030f7f635e224be4126ba2ba1be9fcf3e5a 2023-10-30 06:54:42,535 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 06:54:42,535 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030' 2023-10-30 06:54:42,535 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ff860f014ef44e1087112c5907e73e42 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ff860f014ef44e1087112c5907e73e42 2023-10-30 06:54:42,535 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 06:54:42,535 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030dc210fd1a1134fa3bef38f932b251031 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030dc210fd1a1134fa3bef38f932b251031 2023-10-30 06:54:42,535 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 06:54:42,535 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 06:54:42,535 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 06:54:42,535 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 06:54:42,535 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 06:54:42,535 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 06:54:42,535 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:42,535 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 06:54:42,535 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(367): [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030e5f24c6995b5458e80aff9dbf02f5e47_del] 2023-10-30 06:54:42,536 DEBUG [Listener at localhost/40811] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:42,537 DEBUG [Listener at localhost/40811] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030e5f24c6995b5458e80aff9dbf02f5e47_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030e5f24c6995b5458e80aff9dbf02f5e47_del 2023-10-30 06:54:42,537 INFO [Listener at localhost/40811] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-30 06:54:42,537 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(367): [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310307b1f8621ccf84aadbc5321a3e8c9ea6c_del] 2023-10-30 06:54:42,537 DEBUG [Listener at localhost/40811] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:42,538 DEBUG [Listener at localhost/40811] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310307b1f8621ccf84aadbc5321a3e8c9ea6c_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310307b1f8621ccf84aadbc5321a3e8c9ea6c_del 2023-10-30 06:54:42,538 INFO [Listener at localhost/40811] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-30 06:54:42,538 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(367): [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030d2bd4b766c7042ce87497f2b58340505_del] 2023-10-30 06:54:42,539 DEBUG [Listener at localhost/40811] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:42,540 DEBUG [Listener at localhost/40811] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030d2bd4b766c7042ce87497f2b58340505_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030d2bd4b766c7042ce87497f2b58340505_del 2023-10-30 06:54:42,540 INFO [Listener at localhost/40811] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-30 06:54:42,544 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:54:42,547 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:54:42,552 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:54:42,553 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:54:42,559 INFO [Listener at localhost/40811] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-10-30 06:54:42,559 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testCompactionWithHFileLink 2023-10-30 06:54:42,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-10-30 06:54:42,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-30 06:54:42,563 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648882563"}]},"ts":"1698648882563"} 2023-10-30 06:54:42,565 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-10-30 06:54:42,566 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-10-30 06:54:42,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd2fe0ed654295f84d64a2166ce6f05f, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=570b991da0936dd868ef50ca1259021d, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f040c33a0574cbb9f453444bee0294f2, UNASSIGN}] 2023-10-30 06:54:42,568 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=570b991da0936dd868ef50ca1259021d, UNASSIGN 2023-10-30 06:54:42,568 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd2fe0ed654295f84d64a2166ce6f05f, UNASSIGN 2023-10-30 06:54:42,568 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f040c33a0574cbb9f453444bee0294f2, UNASSIGN 2023-10-30 06:54:42,568 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=570b991da0936dd868ef50ca1259021d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:42,568 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=fd2fe0ed654295f84d64a2166ce6f05f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:42,569 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f040c33a0574cbb9f453444bee0294f2, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:42,569 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698648882568"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648882568"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648882568"}]},"ts":"1698648882568"} 2023-10-30 06:54:42,569 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648882568"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648882568"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648882568"}]},"ts":"1698648882568"} 2023-10-30 06:54:42,569 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648882568"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648882568"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648882568"}]},"ts":"1698648882568"} 2023-10-30 06:54:42,570 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 570b991da0936dd868ef50ca1259021d, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:42,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure fd2fe0ed654295f84d64a2166ce6f05f, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:42,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure f040c33a0574cbb9f453444bee0294f2, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:42,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-30 06:54:42,721 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:42,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:42,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing fd2fe0ed654295f84d64a2166ce6f05f, disabling compactions & flushes 2023-10-30 06:54:42,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:42,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:42,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. after waiting 0 ms 2023-10-30 06:54:42,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:42,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-30 06:54:42,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:42,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:42,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:42,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:42,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f040c33a0574cbb9f453444bee0294f2, disabling compactions & flushes 2023-10-30 06:54:42,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:42,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:42,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. after waiting 0 ms 2023-10-30 06:54:42,732 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=fd2fe0ed654295f84d64a2166ce6f05f, regionState=CLOSED 2023-10-30 06:54:42,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:42,733 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648882732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648882732"}]},"ts":"1698648882732"} 2023-10-30 06:54:42,737 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=89 2023-10-30 06:54:42,737 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure fd2fe0ed654295f84d64a2166ce6f05f, server=jenkins-hbase20.apache.org,40611,1698648765457 in 165 msec 2023-10-30 06:54:42,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd2fe0ed654295f84d64a2166ce6f05f, UNASSIGN in 171 msec 2023-10-30 06:54:42,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-30 06:54:42,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:42,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:42,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:42,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:42,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 570b991da0936dd868ef50ca1259021d, disabling compactions & flushes 2023-10-30 06:54:42,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:42,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:42,742 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f040c33a0574cbb9f453444bee0294f2, regionState=CLOSED 2023-10-30 06:54:42,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. after waiting 0 ms 2023-10-30 06:54:42,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:42,742 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648882742"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648882742"}]},"ts":"1698648882742"} 2023-10-30 06:54:42,745 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-30 06:54:42,745 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure f040c33a0574cbb9f453444bee0294f2, server=jenkins-hbase20.apache.org,40611,1698648765457 in 173 msec 2023-10-30 06:54:42,747 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f040c33a0574cbb9f453444bee0294f2, UNASSIGN in 179 msec 2023-10-30 06:54:42,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-30 06:54:42,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:42,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:42,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:42,750 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=570b991da0936dd868ef50ca1259021d, regionState=CLOSED 2023-10-30 06:54:42,751 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698648882750"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648882750"}]},"ts":"1698648882750"} 2023-10-30 06:54:42,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-30 06:54:42,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 570b991da0936dd868ef50ca1259021d, server=jenkins-hbase20.apache.org,40611,1698648765457 in 182 msec 2023-10-30 06:54:42,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=90, resume processing ppid=88 2023-10-30 06:54:42,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=570b991da0936dd868ef50ca1259021d, UNASSIGN in 188 msec 2023-10-30 06:54:42,756 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648882756"}]},"ts":"1698648882756"} 2023-10-30 06:54:42,757 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-10-30 06:54:42,758 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-10-30 06:54:42,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 199 msec 2023-10-30 06:54:42,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-30 06:54:42,867 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-10-30 06:54:42,885 INFO [Listener at localhost/40811] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1698648871447-1698648882885 2023-10-30 06:54:42,885 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 06:54:42,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698648882885 (current time:1698648882885). 2023-10-30 06:54:42,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-30 06:54:42,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] zookeeper.ReadOnlyZKClient(139): Connect 0x3aab78b9 to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:54:42,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2544bc33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:54:42,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:54:42,893 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:54:42,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3aab78b9 to 127.0.0.1:50449 2023-10-30 06:54:42,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:54:42,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-30 06:54:42,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 06:54:42,897 WARN [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot, current working dir path: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698648871447-1698648882885 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-30 06:54:42,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 06:54:42,899 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 06:54:42,900 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698649482900 2023-10-30 06:54:42,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 06:54:42,900 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1698648871447-1698648882885 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-10-30 06:54:42,900 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:42,900 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-30 06:54:43,000 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 06:54:43,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 06:54:43,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 06:54:43,004 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-30 06:54:43,204 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 06:54:43,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 06:54:43,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 06:54:43,208 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-30 06:54:43,310 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-10-30 06:54:43,314 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-30 06:54:43,314 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-30 06:54:43,314 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-30 06:54:43,314 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-30 06:54:43,314 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-30 06:54:43,314 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-30 06:54:43,314 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-30 06:54:43,314 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-30 06:54:43,317 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/10b80024f88348fdac2479efd2bd3185, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/f9654aace8004b5da2a1a3f7960dcbd5_SeqId_29_] hfiles 2023-10-30 06:54:43,317 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/5d9b695745cc48a98b61a2eb3f7a4508_SeqId_29_, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/b729a4bf39014790b8b78bd140208e4b] hfiles 2023-10-30 06:54:43,317 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/10b80024f88348fdac2479efd2bd3185 2023-10-30 06:54:43,317 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/5d9b695745cc48a98b61a2eb3f7a4508_SeqId_29_ 2023-10-30 06:54:43,317 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2675673e212d46deaf7e785d05024245_SeqId_29_, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/87be04d6a4084237ad1cb921bbeb74bf] hfiles 2023-10-30 06:54:43,318 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/b729a4bf39014790b8b78bd140208e4b 2023-10-30 06:54:43,317 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/f9654aace8004b5da2a1a3f7960dcbd5_SeqId_29_ 2023-10-30 06:54:43,318 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2675673e212d46deaf7e785d05024245_SeqId_29_ 2023-10-30 06:54:43,318 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103030f80c21903443ef92985fb9d0557190, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030843e44dde25a4683807a4539ebec5674, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310306eb59c9d7c5a485fb827959e49bc9703] hfiles 2023-10-30 06:54:43,318 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/87be04d6a4084237ad1cb921bbeb74bf 2023-10-30 06:54:43,318 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103030f80c21903443ef92985fb9d0557190 2023-10-30 06:54:43,318 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030843e44dde25a4683807a4539ebec5674 2023-10-30 06:54:43,318 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310306eb59c9d7c5a485fb827959e49bc9703 2023-10-30 06:54:43,318 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/0bc08403a06a4be985027147f9ee6f8b] hfiles 2023-10-30 06:54:43,318 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/0bc08403a06a4be985027147f9ee6f8b 2023-10-30 06:54:43,319 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/adc329bf9dfc46b1af0ab167a40af97f] hfiles 2023-10-30 06:54:43,319 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/4bf97b85160344bebfdb3ecb9a6d84ab] hfiles 2023-10-30 06:54:43,319 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/adc329bf9dfc46b1af0ab167a40af97f 2023-10-30 06:54:43,319 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/4bf97b85160344bebfdb3ecb9a6d84ab 2023-10-30 06:54:43,325 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030458075cd4ece432fa89db1a3aad8b026, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103093939ba7444a472aab5d00eaac307099_del, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030d1860b52464b42c39fd00d4ed9a3c346, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030db1bf67698e7468c8b6b4bb85f5a8179, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030f1414fcead4c4e1ebaca22d0f411a50b, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103006b9b664c5514c9fa1153865383cdf81, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103097e53b87e5f34f248e15963f74ef273b_del, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e201ac04e37d48f3ae323cedfd079f7c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e6c55353907d47c99ad7c3702a2369a7, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e828ace505c74030bfecc47a9f5ab8da, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103040541d6f6b0f4a7d885d9da46483911b, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103045cf442326eb466d84c3301d31c8c3f7, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103065452d661ff749ed9f7b90ecbdd8a845, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310307f5d717dc8e848fc9b8fcce1da9b4d5a_del, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030c15b5113113243c4b0bdaf6f027e2b48] hfiles 2023-10-30 06:54:43,325 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030458075cd4ece432fa89db1a3aad8b026 2023-10-30 06:54:43,326 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103093939ba7444a472aab5d00eaac307099_del 2023-10-30 06:54:43,326 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030d1860b52464b42c39fd00d4ed9a3c346 2023-10-30 06:54:43,326 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030db1bf67698e7468c8b6b4bb85f5a8179 2023-10-30 06:54:43,326 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030f1414fcead4c4e1ebaca22d0f411a50b 2023-10-30 06:54:43,326 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103006b9b664c5514c9fa1153865383cdf81 2023-10-30 06:54:43,326 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103097e53b87e5f34f248e15963f74ef273b_del 2023-10-30 06:54:43,326 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e201ac04e37d48f3ae323cedfd079f7c 2023-10-30 06:54:43,326 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e6c55353907d47c99ad7c3702a2369a7 2023-10-30 06:54:43,326 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030e828ace505c74030bfecc47a9f5ab8da 2023-10-30 06:54:43,326 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103040541d6f6b0f4a7d885d9da46483911b 2023-10-30 06:54:43,326 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103045cf442326eb466d84c3301d31c8c3f7 2023-10-30 06:54:43,326 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023103065452d661ff749ed9f7b90ecbdd8a845 2023-10-30 06:54:43,326 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310307f5d717dc8e848fc9b8fcce1da9b4d5a_del 2023-10-30 06:54:43,326 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030c15b5113113243c4b0bdaf6f027e2b48 2023-10-30 06:54:43,509 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 06:54:43,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 06:54:43,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 06:54:43,512 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-30 06:54:43,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-10-30 06:54:43,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1698648871447-1698648882885 2023-10-30 06:54:43,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698648871447-1698648882885 2023-10-30 06:54:44,013 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 06:54:44,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 06:54:44,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 06:54:44,016 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-30 06:54:44,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698648871447-1698648882885 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot/hbase-failsafe-snaptb-1698648871447-1698648882885 2023-10-30 06:54:44,168 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1698648871447-1698648882885 of table testCompactionWithHFileLink completed 2023-10-30 06:54:44,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698648871447-1698648882885 2023-10-30 06:54:44,169 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698648871447-1698648882885 2023-10-30 06:54:44,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1698648871447-1698648882885 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698648882900Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1698648883310 (+410 ms)Consolidate snapshot: hbase-failsafe-snaptb-1698648871447-1698648882885 at 1698648883732 (+422 ms)Loading Region manifests for hbase-failsafe-snaptb-1698648871447-1698648882885 at 1698648883732Writing data manifest for hbase-failsafe-snaptb-1698648871447-1698648882885 at 1698648883739 (+7 ms)Verifying snapshot: hbase-failsafe-snaptb-1698648871447-1698648882885 at 1698648884149 (+410 ms)Snapshot hbase-failsafe-snaptb-1698648871447-1698648882885 of table testCompactionWithHFileLink completed at 1698648884168 (+19 ms) 2023-10-30 06:54:44,170 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 06:54:44,171 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2720 sec 2023-10-30 06:54:45,016 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 06:54:45,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 06:54:45,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1698648871447-1698648882885 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-30 06:54:45,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698648871447" table: "testCompactionWithHFileLink" creation_time: 1698648871464 type: FLUSH version: 2 ttl: 0 ) 2023-10-30 06:54:45,062 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1698648871447 as table=testCompactionWithHFileLink 2023-10-30 06:54:45,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-30 06:54:45,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-30 06:54:45,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-30 06:54:45,475 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-10-30 06:54:45,478 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-10-30 06:54:45,478 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-10-30 06:54:45,480 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 06:54:45,487 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1698648871447" table: "testCompactionWithHFileLink" creation_time: 1698648871464 type: FLUSH version: 2 ttl: 0 2023-10-30 06:54:45,488 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink 2023-10-30 06:54:45,493 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-10-30 06:54:45,496 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030843e44dde25a4683807a4539ebec5674 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030843e44dde25a4683807a4539ebec5674 2023-10-30 06:54:45,498 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310306eb59c9d7c5a485fb827959e49bc9703 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310306eb59c9d7c5a485fb827959e49bc9703 2023-10-30 06:54:45,499 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103030f80c21903443ef92985fb9d0557190 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023103030f80c21903443ef92985fb9d0557190 2023-10-30 06:54:45,499 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231030021113c107314bdf8c0b47d024258ba4 of snapshot=snaptb-1698648871447 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 06:54:45,503 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202310303a5284afcab8411081ce6613ef912e22 of snapshot=snaptb-1698648871447 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 06:54:45,506 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202310305edcfbddcf684a71835737c85f5bd817 of snapshot=snaptb-1698648871447 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 06:54:45,510 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231030f7f635e224be4126ba2ba1be9fcf3e5a of snapshot=snaptb-1698648871447 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 06:54:45,514 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202310303fceef27fc2d4879992154582c6d8bab of snapshot=snaptb-1698648871447 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 06:54:45,517 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202310305dbea680af974ad09bf5c3e588e97cb9 of snapshot=snaptb-1698648871447 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 06:54:45,521 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231030a59c36962fd24b01ae640827bf734827 of snapshot=snaptb-1698648871447 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 06:54:45,525 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231030ff860f014ef44e1087112c5907e73e42 of snapshot=snaptb-1698648871447 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 06:54:45,529 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202310300f8da9cf0fb940a5818d169aa3781714 of snapshot=snaptb-1698648871447 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 06:54:45,534 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231030ad5a576fe6a347fa83c01cded63f3d5a of snapshot=snaptb-1698648871447 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 06:54:45,537 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231030d9eea4afc2d84573bb823800ab8f4715 of snapshot=snaptb-1698648871447 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 06:54:45,540 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231030dc210fd1a1134fa3bef38f932b251031 of snapshot=snaptb-1698648871447 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 06:54:45,544 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103097e53b87e5f34f248e15963f74ef273b_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103097e53b87e5f34f248e15963f74ef273b_del 2023-10-30 06:54:45,545 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103093939ba7444a472aab5d00eaac307099_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103093939ba7444a472aab5d00eaac307099_del 2023-10-30 06:54:45,546 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310307f5d717dc8e848fc9b8fcce1da9b4d5a_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310307f5d717dc8e848fc9b8fcce1da9b4d5a_del 2023-10-30 06:54:45,546 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:45,546 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:45,546 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:45,551 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/10b80024f88348fdac2479efd2bd3185 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/10b80024f88348fdac2479efd2bd3185 2023-10-30 06:54:45,551 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2675673e212d46deaf7e785d05024245_SeqId_29_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/2675673e212d46deaf7e785d05024245_SeqId_29_ 2023-10-30 06:54:45,551 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/b729a4bf39014790b8b78bd140208e4b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/b729a4bf39014790b8b78bd140208e4b 2023-10-30 06:54:45,553 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/f9654aace8004b5da2a1a3f7960dcbd5_SeqId_29_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/f9654aace8004b5da2a1a3f7960dcbd5_SeqId_29_ 2023-10-30 06:54:45,553 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b95281a1720c482b9ec17a02a87d6b65 of snapshot=snaptb-1698648871447 to region=570b991da0936dd868ef50ca1259021d table=testCompactionWithHFileLink 2023-10-30 06:54:45,553 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/87be04d6a4084237ad1cb921bbeb74bf to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/87be04d6a4084237ad1cb921bbeb74bf 2023-10-30 06:54:45,553 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a41eae486c58411297cc1080d02cc7f6 of snapshot=snaptb-1698648871447 to region=f040c33a0574cbb9f453444bee0294f2 table=testCompactionWithHFileLink 2023-10-30 06:54:45,553 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/5d9b695745cc48a98b61a2eb3f7a4508_SeqId_29_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/5d9b695745cc48a98b61a2eb3f7a4508_SeqId_29_ 2023-10-30 06:54:45,553 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink dc3f481d4da4462b8763896c8e74cbda of snapshot=snaptb-1698648871447 to region=fd2fe0ed654295f84d64a2166ce6f05f table=testCompactionWithHFileLink 2023-10-30 06:54:45,559 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0133c3bcd7234223b3f1953aa36bf981 of snapshot=snaptb-1698648871447 to region=fd2fe0ed654295f84d64a2166ce6f05f table=testCompactionWithHFileLink 2023-10-30 06:54:45,559 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7f09297a98814e8fb694af5775f3ab6a of snapshot=snaptb-1698648871447 to region=570b991da0936dd868ef50ca1259021d table=testCompactionWithHFileLink 2023-10-30 06:54:45,559 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2d93a80180a04d768aad4a10056d9f3d of snapshot=snaptb-1698648871447 to region=f040c33a0574cbb9f453444bee0294f2 table=testCompactionWithHFileLink 2023-10-30 06:54:45,562 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 40770f8b14244f33ab8455fefea8d2ef of snapshot=snaptb-1698648871447 to region=fd2fe0ed654295f84d64a2166ce6f05f table=testCompactionWithHFileLink 2023-10-30 06:54:45,566 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d8eed4b92a704b0792b454c0e5bbae8a of snapshot=snaptb-1698648871447 to region=570b991da0936dd868ef50ca1259021d table=testCompactionWithHFileLink 2023-10-30 06:54:45,567 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a981bc4dceb146cdaedd5eabb59ba867 of snapshot=snaptb-1698648871447 to region=f040c33a0574cbb9f453444bee0294f2 table=testCompactionWithHFileLink 2023-10-30 06:54:45,569 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e9293e91bcc441c3bb7ecbf6ae816e8c of snapshot=snaptb-1698648871447 to region=fd2fe0ed654295f84d64a2166ce6f05f table=testCompactionWithHFileLink 2023-10-30 06:54:45,570 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d952b53beec64936896c3e5e46d2c1e8 of snapshot=snaptb-1698648871447 to region=570b991da0936dd868ef50ca1259021d table=testCompactionWithHFileLink 2023-10-30 06:54:45,570 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 833c20f5c1334866b4f63be6e638fcd8 of snapshot=snaptb-1698648871447 to region=f040c33a0574cbb9f453444bee0294f2 table=testCompactionWithHFileLink 2023-10-30 06:54:45,574 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/0bc08403a06a4be985027147f9ee6f8b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/0bc08403a06a4be985027147f9ee6f8b 2023-10-30 06:54:45,575 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fca7c332984945bc80b348cc51442c60 of snapshot=snaptb-1698648871447 to region=fd2fe0ed654295f84d64a2166ce6f05f table=testCompactionWithHFileLink 2023-10-30 06:54:45,575 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/4bf97b85160344bebfdb3ecb9a6d84ab to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/4bf97b85160344bebfdb3ecb9a6d84ab 2023-10-30 06:54:45,575 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/adc329bf9dfc46b1af0ab167a40af97f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/adc329bf9dfc46b1af0ab167a40af97f 2023-10-30 06:54:45,575 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4c3c36b07c38401baf150fc472fcdae5 of snapshot=snaptb-1698648871447 to region=f040c33a0574cbb9f453444bee0294f2 table=testCompactionWithHFileLink 2023-10-30 06:54:45,575 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 19947e0cbcef4f759642e84ac7b612ca of snapshot=snaptb-1698648871447 to region=570b991da0936dd868ef50ca1259021d table=testCompactionWithHFileLink 2023-10-30 06:54:45,578 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ab029fd919ee4a8789fc32de37bafa2c of snapshot=snaptb-1698648871447 to region=fd2fe0ed654295f84d64a2166ce6f05f table=testCompactionWithHFileLink 2023-10-30 06:54:45,578 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink de8c6da443c44db4962a4fe779a42cb7 of snapshot=snaptb-1698648871447 to region=f040c33a0574cbb9f453444bee0294f2 table=testCompactionWithHFileLink 2023-10-30 06:54:45,578 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fd4594129f1249819d49581025e122ab of snapshot=snaptb-1698648871447 to region=570b991da0936dd868ef50ca1259021d table=testCompactionWithHFileLink 2023-10-30 06:54:45,582 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0504fd6f8ad2495d8fbf2f3069916bbf of snapshot=snaptb-1698648871447 to region=570b991da0936dd868ef50ca1259021d table=testCompactionWithHFileLink 2023-10-30 06:54:45,582 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e630c91fb8df4e43aff22d715e18a0af of snapshot=snaptb-1698648871447 to region=f040c33a0574cbb9f453444bee0294f2 table=testCompactionWithHFileLink 2023-10-30 06:54:45,582 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 618962d22cca49e5b9a996d4747b7f1f of snapshot=snaptb-1698648871447 to region=fd2fe0ed654295f84d64a2166ce6f05f table=testCompactionWithHFileLink 2023-10-30 06:54:45,586 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 99125cfc1c274a58b5463561f1bd5ea2 of snapshot=snaptb-1698648871447 to region=570b991da0936dd868ef50ca1259021d table=testCompactionWithHFileLink 2023-10-30 06:54:45,586 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 56fe2f93c1894199acc149c0f92b364a of snapshot=snaptb-1698648871447 to region=f040c33a0574cbb9f453444bee0294f2 table=testCompactionWithHFileLink 2023-10-30 06:54:45,586 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d6922695a3a84331b7d8e02c3b7aa2cb of snapshot=snaptb-1698648871447 to region=fd2fe0ed654295f84d64a2166ce6f05f table=testCompactionWithHFileLink 2023-10-30 06:54:45,590 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1698648871447" table: "testCompactionWithHFileLink" creation_time: 1698648871464 type: FLUSH version: 2 ttl: 0 2023-10-30 06:54:45,591 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698648885591"}]},"ts":"9223372036854775807"} 2023-10-30 06:54:45,591 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698648885591"}]},"ts":"9223372036854775807"} 2023-10-30 06:54:45,591 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698648885591"}]},"ts":"9223372036854775807"} 2023-10-30 06:54:45,593 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-10-30 06:54:45,593 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 570b991da0936dd868ef50ca1259021d, NAME => 'testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => f040c33a0574cbb9f453444bee0294f2, NAME => 'testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => fd2fe0ed654295f84d64a2166ce6f05f, NAME => 'testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.', STARTKEY => '', ENDKEY => '1'}] 2023-10-30 06:54:45,593 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698648885592"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648885592"}]},"ts":"1698648885592"} 2023-10-30 06:54:45,593 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648885592"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648885592"}]},"ts":"1698648885592"} 2023-10-30 06:54:45,593 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648885592"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648885592"}]},"ts":"1698648885592"} 2023-10-30 06:54:45,595 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 06:54:45,595 INFO [PEWorker-1] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-10-30 06:54:45,595 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 570b991da0936dd868ef50ca1259021d, NAME => 'testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => f040c33a0574cbb9f453444bee0294f2, NAME => 'testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => fd2fe0ed654295f84d64a2166ce6f05f, NAME => 'testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.', STARTKEY => '', ENDKEY => '1'}] 2023-10-30 06:54:45,595 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1698648871447 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-10-30 06:54:45,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698648871447" table: "testCompactionWithHFileLink" creation_time: 1698648871464 type: FLUSH version: 2 ttl: 0 ) in 542 msec 2023-10-30 06:54:45,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-30 06:54:45,672 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-10-30 06:54:45,672 INFO [Listener at localhost/40811] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1698648871447-1698648882885 2023-10-30 06:54:45,680 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "hbase-failsafe-snaptb-1698648871447-1698648882885" 2023-10-30 06:54:45,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1698648871447-1698648882885 2023-10-30 06:54:45,685 INFO [Listener at localhost/40811] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-10-30 06:54:45,689 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.HMaster$10(2385): Client=jenkins//148.251.75.209 enable testCompactionWithHFileLink 2023-10-30 06:54:45,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-10-30 06:54:45,697 INFO [PEWorker-2] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-10-30 06:54:45,697 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648885697"}]},"ts":"1698648885697"} 2023-10-30 06:54:45,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-30 06:54:45,698 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-10-30 06:54:45,700 DEBUG [PEWorker-2] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-10-30 06:54:45,701 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd2fe0ed654295f84d64a2166ce6f05f, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=570b991da0936dd868ef50ca1259021d, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f040c33a0574cbb9f453444bee0294f2, ASSIGN}] 2023-10-30 06:54:45,702 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f040c33a0574cbb9f453444bee0294f2, ASSIGN 2023-10-30 06:54:45,702 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=570b991da0936dd868ef50ca1259021d, ASSIGN 2023-10-30 06:54:45,702 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd2fe0ed654295f84d64a2166ce6f05f, ASSIGN 2023-10-30 06:54:45,702 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f040c33a0574cbb9f453444bee0294f2, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-30 06:54:45,703 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=570b991da0936dd868ef50ca1259021d, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-30 06:54:45,703 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd2fe0ed654295f84d64a2166ce6f05f, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-30 06:54:45,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-30 06:54:45,855 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=570b991da0936dd868ef50ca1259021d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:45,855 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f040c33a0574cbb9f453444bee0294f2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:45,855 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=fd2fe0ed654295f84d64a2166ce6f05f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:45,856 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648885855"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648885855"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648885855"}]},"ts":"1698648885855"} 2023-10-30 06:54:45,856 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648885855"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648885855"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648885855"}]},"ts":"1698648885855"} 2023-10-30 06:54:45,856 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698648885855"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648885855"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648885855"}]},"ts":"1698648885855"} 2023-10-30 06:54:45,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure f040c33a0574cbb9f453444bee0294f2, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:45,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure fd2fe0ed654295f84d64a2166ce6f05f, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:45,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure 570b991da0936dd868ef50ca1259021d, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:46,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-30 06:54:46,011 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:46,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:46,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f040c33a0574cbb9f453444bee0294f2, NAME => 'testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 06:54:46,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:46,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:46,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:46,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:46,022 INFO [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:46,023 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1 2023-10-30 06:54:46,023 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1 2023-10-30 06:54:46,023 INFO [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f040c33a0574cbb9f453444bee0294f2 columnFamilyName family1 2023-10-30 06:54:46,033 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-2d93a80180a04d768aad4a10056d9f3d 2023-10-30 06:54:46,040 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-833c20f5c1334866b4f63be6e638fcd8 2023-10-30 06:54:46,046 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-a41eae486c58411297cc1080d02cc7f6 2023-10-30 06:54:46,052 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-a981bc4dceb146cdaedd5eabb59ba867 2023-10-30 06:54:46,052 INFO [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(310): Store=f040c33a0574cbb9f453444bee0294f2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:46,053 INFO [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:46,054 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2 2023-10-30 06:54:46,054 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2 2023-10-30 06:54:46,054 INFO [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f040c33a0574cbb9f453444bee0294f2 columnFamilyName family2 2023-10-30 06:54:46,062 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-4c3c36b07c38401baf150fc472fcdae5 2023-10-30 06:54:46,067 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-56fe2f93c1894199acc149c0f92b364a 2023-10-30 06:54:46,072 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-de8c6da443c44db4962a4fe779a42cb7 2023-10-30 06:54:46,076 DEBUG [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-e630c91fb8df4e43aff22d715e18a0af 2023-10-30 06:54:46,077 INFO [StoreOpener-f040c33a0574cbb9f453444bee0294f2-1] regionserver.HStore(310): Store=f040c33a0574cbb9f453444bee0294f2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:46,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:46,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:46,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:54:46,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:54:46,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f040c33a0574cbb9f453444bee0294f2; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61126719, jitterRate=-0.08914090692996979}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:54:46,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:46,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2., pid=101, masterSystemTime=1698648886011 2023-10-30 06:54:46,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:54:46,082 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-30 06:54:46,082 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-30 06:54:46,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-30 06:54:46,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:46,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:46,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:46,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fd2fe0ed654295f84d64a2166ce6f05f, NAME => 'testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 06:54:46,084 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f040c33a0574cbb9f453444bee0294f2, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:46,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:46,084 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648886084"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648886084"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648886084"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648886084"}]},"ts":"1698648886084"} 2023-10-30 06:54:46,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:46,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:46,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:46,085 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-30 06:54:46,085 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1912): f040c33a0574cbb9f453444bee0294f2/family1 is initiating minor compaction (all files) 2023-10-30 06:54:46,085 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f040c33a0574cbb9f453444bee0294f2/family1 in testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:46,086 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-a41eae486c58411297cc1080d02cc7f6, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-2d93a80180a04d768aad4a10056d9f3d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-a981bc4dceb146cdaedd5eabb59ba867, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-833c20f5c1334866b4f63be6e638fcd8] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp, totalSize=21.6 K 2023-10-30 06:54:46,086 INFO [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:46,086 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-30 06:54:46,086 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HStore(1912): f040c33a0574cbb9f453444bee0294f2/family2 is initiating minor compaction (all files) 2023-10-30 06:54:46,086 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HRegion(2259): Starting compaction of f040c33a0574cbb9f453444bee0294f2/family2 in testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:54:46,086 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-4c3c36b07c38401baf150fc472fcdae5, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-de8c6da443c44db4962a4fe779a42cb7, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-e630c91fb8df4e43aff22d715e18a0af, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-56fe2f93c1894199acc149c0f92b364a] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp, totalSize=20.4 K 2023-10-30 06:54:46,087 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-a41eae486c58411297cc1080d02cc7f6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648864029 2023-10-30 06:54:46,087 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-4c3c36b07c38401baf150fc472fcdae5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648864029 2023-10-30 06:54:46,088 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=100 2023-10-30 06:54:46,088 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1 2023-10-30 06:54:46,088 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1 2023-10-30 06:54:46,088 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure f040c33a0574cbb9f453444bee0294f2, server=jenkins-hbase20.apache.org,40611,1698648765457 in 228 msec 2023-10-30 06:54:46,088 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-2d93a80180a04d768aad4a10056d9f3d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648865842 2023-10-30 06:54:46,088 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-de8c6da443c44db4962a4fe779a42cb7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648865842 2023-10-30 06:54:46,088 INFO [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd2fe0ed654295f84d64a2166ce6f05f columnFamilyName family1 2023-10-30 06:54:46,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f040c33a0574cbb9f453444bee0294f2, ASSIGN in 387 msec 2023-10-30 06:54:46,089 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-a981bc4dceb146cdaedd5eabb59ba867, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648867674 2023-10-30 06:54:46,089 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-e630c91fb8df4e43aff22d715e18a0af, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648867674 2023-10-30 06:54:46,090 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-833c20f5c1334866b4f63be6e638fcd8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648869621 2023-10-30 06:54:46,090 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-56fe2f93c1894199acc149c0f92b364a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648869621 2023-10-30 06:54:46,104 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-0133c3bcd7234223b3f1953aa36bf981 2023-10-30 06:54:46,113 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-40770f8b14244f33ab8455fefea8d2ef 2023-10-30 06:54:46,120 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): f040c33a0574cbb9f453444bee0294f2#family1#compaction#113 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:54:46,121 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-dc3f481d4da4462b8763896c8e74cbda 2023-10-30 06:54:46,125 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] throttle.PressureAwareThroughputController(145): f040c33a0574cbb9f453444bee0294f2#family2#compaction#114 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:54:46,137 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-e9293e91bcc441c3bb7ecbf6ae816e8c 2023-10-30 06:54:46,140 INFO [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(310): Store=fd2fe0ed654295f84d64a2166ce6f05f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:46,140 INFO [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:46,141 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2 2023-10-30 06:54:46,141 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2 2023-10-30 06:54:46,141 INFO [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd2fe0ed654295f84d64a2166ce6f05f columnFamilyName family2 2023-10-30 06:54:46,148 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-618962d22cca49e5b9a996d4747b7f1f 2023-10-30 06:54:46,152 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-ab029fd919ee4a8789fc32de37bafa2c 2023-10-30 06:54:46,155 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-d6922695a3a84331b7d8e02c3b7aa2cb 2023-10-30 06:54:46,159 DEBUG [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-fca7c332984945bc80b348cc51442c60 2023-10-30 06:54:46,159 INFO [StoreOpener-fd2fe0ed654295f84d64a2166ce6f05f-1] regionserver.HStore(310): Store=fd2fe0ed654295f84d64a2166ce6f05f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:46,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:46,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:46,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:54:46,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:54:46,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened fd2fe0ed654295f84d64a2166ce6f05f; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63673895, jitterRate=-0.05118502676486969}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:54:46,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:46,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f., pid=102, masterSystemTime=1698648886011 2023-10-30 06:54:46,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-30 06:54:46,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-10-30 06:54:46,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:46,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:46,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:46,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 570b991da0936dd868ef50ca1259021d, NAME => 'testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 06:54:46,167 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=fd2fe0ed654295f84d64a2166ce6f05f, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:46,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:46,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:46,167 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698648886167"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648886167"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648886167"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648886167"}]},"ts":"1698648886167"} 2023-10-30 06:54:46,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:46,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:46,169 INFO [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:46,170 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1 2023-10-30 06:54:46,170 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1 2023-10-30 06:54:46,170 INFO [StoreOpener-570b991da0936dd868ef50ca1259021d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 570b991da0936dd868ef50ca1259021d columnFamilyName family1 2023-10-30 06:54:46,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=98 2023-10-30 06:54:46,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure fd2fe0ed654295f84d64a2166ce6f05f, server=jenkins-hbase20.apache.org,40611,1698648765457 in 310 msec 2023-10-30 06:54:46,171 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd2fe0ed654295f84d64a2166ce6f05f, ASSIGN in 469 msec 2023-10-30 06:54:46,179 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-7f09297a98814e8fb694af5775f3ab6a 2023-10-30 06:54:46,185 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-b95281a1720c482b9ec17a02a87d6b65 2023-10-30 06:54:46,195 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-d8eed4b92a704b0792b454c0e5bbae8a 2023-10-30 06:54:46,210 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-d952b53beec64936896c3e5e46d2c1e8 2023-10-30 06:54:46,210 INFO [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(310): Store=570b991da0936dd868ef50ca1259021d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:46,210 INFO [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:46,212 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2 2023-10-30 06:54:46,212 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2 2023-10-30 06:54:46,212 INFO [StoreOpener-570b991da0936dd868ef50ca1259021d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 570b991da0936dd868ef50ca1259021d columnFamilyName family2 2023-10-30 06:54:46,223 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-0504fd6f8ad2495d8fbf2f3069916bbf 2023-10-30 06:54:46,232 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-19947e0cbcef4f759642e84ac7b612ca 2023-10-30 06:54:46,241 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-99125cfc1c274a58b5463561f1bd5ea2 2023-10-30 06:54:46,247 DEBUG [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(539): loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-fd4594129f1249819d49581025e122ab 2023-10-30 06:54:46,247 INFO [StoreOpener-570b991da0936dd868ef50ca1259021d-1] regionserver.HStore(310): Store=570b991da0936dd868ef50ca1259021d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:46,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:46,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:46,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:54:46,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 570b991da0936dd868ef50ca1259021d 2023-10-30 06:54:46,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 570b991da0936dd868ef50ca1259021d; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71511435, jitterRate=0.06560342013835907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:54:46,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:46,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d., pid=103, masterSystemTime=1698648886011 2023-10-30 06:54:46,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-30 06:54:46,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-30 06:54:46,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:46,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:46,253 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=570b991da0936dd868ef50ca1259021d, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:46,254 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698648886253"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648886253"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648886253"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648886253"}]},"ts":"1698648886253"} 2023-10-30 06:54:46,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=99 2023-10-30 06:54:46,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure 570b991da0936dd868ef50ca1259021d, server=jenkins-hbase20.apache.org,40611,1698648765457 in 395 msec 2023-10-30 06:54:46,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=99, resume processing ppid=97 2023-10-30 06:54:46,257 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=570b991da0936dd868ef50ca1259021d, ASSIGN in 555 msec 2023-10-30 06:54:46,257 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648886257"}]},"ts":"1698648886257"} 2023-10-30 06:54:46,258 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-10-30 06:54:46,259 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-10-30 06:54:46,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 569 msec 2023-10-30 06:54:46,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-30 06:54:46,303 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-10-30 06:54:46,325 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:54:46,332 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:54:46,341 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:54:46,342 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:54:46,347 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 06:54:46,360 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-10-30 06:54:46,360 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:46,362 DEBUG [Listener at localhost/40811] zookeeper.ReadOnlyZKClient(139): Connect 0x70a40077 to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:54:46,366 DEBUG [Listener at localhost/40811] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52c5341d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:54:46,367 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 06:54:46,367 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 06:54:46,367 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 06:54:46,925 DEBUG [regionserver/jenkins-hbase20:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-10-30 06:54:46,959 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family1/17f162d8a65346ae9f9bc14ec323ddf0 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/17f162d8a65346ae9f9bc14ec323ddf0 2023-10-30 06:54:46,959 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/.tmp/family2/c30885ed507040589a5c98e33e79dfd9 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/c30885ed507040589a5c98e33e79dfd9 2023-10-30 06:54:46,966 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f040c33a0574cbb9f453444bee0294f2/family2 of f040c33a0574cbb9f453444bee0294f2 into c30885ed507040589a5c98e33e79dfd9(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:54:46,966 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f040c33a0574cbb9f453444bee0294f2/family1 of f040c33a0574cbb9f453444bee0294f2 into 17f162d8a65346ae9f9bc14ec323ddf0(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:54:46,966 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:46,966 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:46,966 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2., storeName=f040c33a0574cbb9f453444bee0294f2/family2, priority=12, startTime=1698648886082; duration=0sec 2023-10-30 06:54:46,966 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2., storeName=f040c33a0574cbb9f453444bee0294f2/family1, priority=12, startTime=1698648886082; duration=0sec 2023-10-30 06:54:46,966 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-30 06:54:46,966 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-30 06:54:46,967 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-30 06:54:46,967 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-30 06:54:46,969 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-30 06:54:46,970 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HStore(1912): fd2fe0ed654295f84d64a2166ce6f05f/family1 is initiating minor compaction (all files) 2023-10-30 06:54:46,970 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-30 06:54:46,970 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HRegion(2259): Starting compaction of fd2fe0ed654295f84d64a2166ce6f05f/family1 in testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:46,970 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1912): 570b991da0936dd868ef50ca1259021d/family2 is initiating minor compaction (all files) 2023-10-30 06:54:46,970 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-dc3f481d4da4462b8763896c8e74cbda, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-0133c3bcd7234223b3f1953aa36bf981, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-40770f8b14244f33ab8455fefea8d2ef, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-e9293e91bcc441c3bb7ecbf6ae816e8c] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp, totalSize=21.6 K 2023-10-30 06:54:46,970 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 570b991da0936dd868ef50ca1259021d/family2 in testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:46,970 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-19947e0cbcef4f759642e84ac7b612ca, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-fd4594129f1249819d49581025e122ab, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-0504fd6f8ad2495d8fbf2f3069916bbf, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-99125cfc1c274a58b5463561f1bd5ea2] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp, totalSize=20.4 K 2023-10-30 06:54:46,970 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-dc3f481d4da4462b8763896c8e74cbda, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648864028 2023-10-30 06:54:46,970 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-19947e0cbcef4f759642e84ac7b612ca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648864029 2023-10-30 06:54:46,971 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-0133c3bcd7234223b3f1953aa36bf981, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648865841 2023-10-30 06:54:46,971 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-fd4594129f1249819d49581025e122ab, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648865841 2023-10-30 06:54:46,971 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-40770f8b14244f33ab8455fefea8d2ef, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648867673 2023-10-30 06:54:46,971 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-0504fd6f8ad2495d8fbf2f3069916bbf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648867674 2023-10-30 06:54:46,972 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-e9293e91bcc441c3bb7ecbf6ae816e8c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648869619 2023-10-30 06:54:46,972 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-99125cfc1c274a58b5463561f1bd5ea2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648869621 2023-10-30 06:54:46,987 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): 570b991da0936dd868ef50ca1259021d#family2#compaction#116 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 53.85 MB/second 2023-10-30 06:54:46,988 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] throttle.PressureAwareThroughputController(145): fd2fe0ed654295f84d64a2166ce6f05f#family1#compaction#115 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-30 06:54:47,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-a41eae486c58411297cc1080d02cc7f6, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-2d93a80180a04d768aad4a10056d9f3d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-a981bc4dceb146cdaedd5eabb59ba867, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-833c20f5c1334866b4f63be6e638fcd8] to archive 2023-10-30 06:54:47,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:47,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-a41eae486c58411297cc1080d02cc7f6 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-a41eae486c58411297cc1080d02cc7f6 2023-10-30 06:54:47,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-2d93a80180a04d768aad4a10056d9f3d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-2d93a80180a04d768aad4a10056d9f3d 2023-10-30 06:54:47,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-a981bc4dceb146cdaedd5eabb59ba867 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-a981bc4dceb146cdaedd5eabb59ba867 2023-10-30 06:54:47,016 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-833c20f5c1334866b4f63be6e638fcd8 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-833c20f5c1334866b4f63be6e638fcd8 2023-10-30 06:54:47,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-4c3c36b07c38401baf150fc472fcdae5, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-de8c6da443c44db4962a4fe779a42cb7, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-e630c91fb8df4e43aff22d715e18a0af, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-56fe2f93c1894199acc149c0f92b364a] to archive 2023-10-30 06:54:47,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:47,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-4c3c36b07c38401baf150fc472fcdae5 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-4c3c36b07c38401baf150fc472fcdae5 2023-10-30 06:54:47,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-de8c6da443c44db4962a4fe779a42cb7 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-de8c6da443c44db4962a4fe779a42cb7 2023-10-30 06:54:47,022 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-e630c91fb8df4e43aff22d715e18a0af to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-e630c91fb8df4e43aff22d715e18a0af 2023-10-30 06:54:47,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-56fe2f93c1894199acc149c0f92b364a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family2/testCompactionWithHFileLink=f040c33a0574cbb9f453444bee0294f2-56fe2f93c1894199acc149c0f92b364a 2023-10-30 06:54:47,268 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310307c78debdcad14a9caa42e4867a765b26 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310307c78debdcad14a9caa42e4867a765b26 2023-10-30 06:54:47,268 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030ebe651bb559940daa1c3ef9b142ab7ca to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030ebe651bb559940daa1c3ef9b142ab7ca 2023-10-30 06:54:47,269 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103058d91b90eedd4b94936c7d8e0634fc1c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023103058d91b90eedd4b94936c7d8e0634fc1c 2023-10-30 06:54:47,269 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:47,270 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:47,270 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:47,282 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:54:47,285 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:54:47,290 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:54:47,297 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:54:47,313 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/4a85f1172e134429959cf6bed5c5be5c first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-10-30 06:54:47,320 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=32 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/4a85f1172e134429959cf6bed5c5be5c}] 2023-10-30 06:54:47,328 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/154cb9c2d8bb4b79b03026571a024eee first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-10-30 06:54:47,328 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/477ef8e89d8547e88a236e3232753814 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-10-30 06:54:47,329 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/477ef8e89d8547e88a236e3232753814}] 2023-10-30 06:54:47,329 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/154cb9c2d8bb4b79b03026571a024eee}] 2023-10-30 06:54:47,330 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/4a85f1172e134429959cf6bed5c5be5c for inclusion in fd2fe0ed654295f84d64a2166ce6f05f/family1 2023-10-30 06:54:47,332 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/154cb9c2d8bb4b79b03026571a024eee for inclusion in f040c33a0574cbb9f453444bee0294f2/family1 2023-10-30 06:54:47,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/477ef8e89d8547e88a236e3232753814 for inclusion in 570b991da0936dd868ef50ca1259021d/family1 2023-10-30 06:54:47,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-10-30 06:54:47,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last=1 2023-10-30 06:54:47,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:47,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/4a85f1172e134429959cf6bed5c5be5c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__ti8ik65lf2h0ang83p4ur81pqpfnssovnvd1615a9jh75g1n6531b1hmoig631o9/family1/4a85f1172e134429959cf6bed5c5be5c 2023-10-30 06:54:47,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-10-30 06:54:47,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-10-30 06:54:47,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 06:54:47,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-30 06:54:47,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:54:47,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:47,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/154cb9c2d8bb4b79b03026571a024eee to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__u5m0jgfqs3nmochiu7m051te667624lf7hg3758qves62d1sbc8l27v63rcfd91n/family1/154cb9c2d8bb4b79b03026571a024eee 2023-10-30 06:54:47,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/477ef8e89d8547e88a236e3232753814 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__5kd5ob0ik8v3s3c8e900eoqu1d2hvlpom7mkibjeghge0uk1eqnhq6ddf50ees7b/family1/477ef8e89d8547e88a236e3232753814 2023-10-30 06:54:47,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__ti8ik65lf2h0ang83p4ur81pqpfnssovnvd1615a9jh75g1n6531b1hmoig631o9/family1/4a85f1172e134429959cf6bed5c5be5c as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/0a40e04f10fd480fa99516f894477c1d_SeqId_34_ 2023-10-30 06:54:47,337 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__ti8ik65lf2h0ang83p4ur81pqpfnssovnvd1615a9jh75g1n6531b1hmoig631o9/family1/4a85f1172e134429959cf6bed5c5be5c into fd2fe0ed654295f84d64a2166ce6f05f/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/0a40e04f10fd480fa99516f894477c1d_SeqId_34_ - updating store file list. 2023-10-30 06:54:47,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__u5m0jgfqs3nmochiu7m051te667624lf7hg3758qves62d1sbc8l27v63rcfd91n/family1/154cb9c2d8bb4b79b03026571a024eee as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/31c8a1c9d7624f29b738ce8dbc09ba25_SeqId_36_ 2023-10-30 06:54:47,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__5kd5ob0ik8v3s3c8e900eoqu1d2hvlpom7mkibjeghge0uk1eqnhq6ddf50ees7b/family1/477ef8e89d8547e88a236e3232753814 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/30cce5de58984a398a62d9ac06aac3eb_SeqId_34_ 2023-10-30 06:54:47,337 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__u5m0jgfqs3nmochiu7m051te667624lf7hg3758qves62d1sbc8l27v63rcfd91n/family1/154cb9c2d8bb4b79b03026571a024eee into f040c33a0574cbb9f453444bee0294f2/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/31c8a1c9d7624f29b738ce8dbc09ba25_SeqId_36_ - updating store file list. 2023-10-30 06:54:47,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__5kd5ob0ik8v3s3c8e900eoqu1d2hvlpom7mkibjeghge0uk1eqnhq6ddf50ees7b/family1/477ef8e89d8547e88a236e3232753814 into 570b991da0936dd868ef50ca1259021d/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/30cce5de58984a398a62d9ac06aac3eb_SeqId_34_ - updating store file list. 2023-10-30 06:54:47,340 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/0a40e04f10fd480fa99516f894477c1d_SeqId_34_ into fd2fe0ed654295f84d64a2166ce6f05f/family1 2023-10-30 06:54:47,340 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__ti8ik65lf2h0ang83p4ur81pqpfnssovnvd1615a9jh75g1n6531b1hmoig631o9/family1/4a85f1172e134429959cf6bed5c5be5c into fd2fe0ed654295f84d64a2166ce6f05f/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/0a40e04f10fd480fa99516f894477c1d_SeqId_34_) 2023-10-30 06:54:47,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/30cce5de58984a398a62d9ac06aac3eb_SeqId_34_ into 570b991da0936dd868ef50ca1259021d/family1 2023-10-30 06:54:47,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__5kd5ob0ik8v3s3c8e900eoqu1d2hvlpom7mkibjeghge0uk1eqnhq6ddf50ees7b/family1/477ef8e89d8547e88a236e3232753814 into 570b991da0936dd868ef50ca1259021d/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/30cce5de58984a398a62d9ac06aac3eb_SeqId_34_) 2023-10-30 06:54:47,340 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/31c8a1c9d7624f29b738ce8dbc09ba25_SeqId_36_ into f040c33a0574cbb9f453444bee0294f2/family1 2023-10-30 06:54:47,341 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__u5m0jgfqs3nmochiu7m051te667624lf7hg3758qves62d1sbc8l27v63rcfd91n/family1/154cb9c2d8bb4b79b03026571a024eee into f040c33a0574cbb9f453444bee0294f2/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/family1/31c8a1c9d7624f29b738ce8dbc09ba25_SeqId_36_) 2023-10-30 06:54:47,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__ti8ik65lf2h0ang83p4ur81pqpfnssovnvd1615a9jh75g1n6531b1hmoig631o9/family1/4a85f1172e134429959cf6bed5c5be5c 2023-10-30 06:54:47,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__5kd5ob0ik8v3s3c8e900eoqu1d2hvlpom7mkibjeghge0uk1eqnhq6ddf50ees7b/family1/477ef8e89d8547e88a236e3232753814 2023-10-30 06:54:47,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:54:47,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testCompactionWithHFileLink__u5m0jgfqs3nmochiu7m051te667624lf7hg3758qves62d1sbc8l27v63rcfd91n/family1/154cb9c2d8bb4b79b03026571a024eee 2023-10-30 06:54:47,343 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:47,343 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:47,344 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:47,344 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:47,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-10-30 06:54:47,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(1912): 570b991da0936dd868ef50ca1259021d/family1 is initiating minor compaction (all files) 2023-10-30 06:54:47,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@59cc5ff3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-30 06:54:47,346 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310300f8da9cf0fb940a5818d169aa3781714 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310300f8da9cf0fb940a5818d169aa3781714 2023-10-30 06:54:47,346 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310303fceef27fc2d4879992154582c6d8bab to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310303fceef27fc2d4879992154582c6d8bab 2023-10-30 06:54:47,346 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:47,347 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:47,347 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030ad5a576fe6a347fa83c01cded63f3d5a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030ad5a576fe6a347fa83c01cded63f3d5a 2023-10-30 06:54:47,347 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310305dbea680af974ad09bf5c3e588e97cb9 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310305dbea680af974ad09bf5c3e588e97cb9 2023-10-30 06:54:47,348 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030d9eea4afc2d84573bb823800ab8f4715 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030d9eea4afc2d84573bb823800ab8f4715 2023-10-30 06:54:47,348 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231030a59c36962fd24b01ae640827bf734827 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231030a59c36962fd24b01ae640827bf734827 2023-10-30 06:54:47,348 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231030021113c107314bdf8c0b47d024258ba4 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231030021113c107314bdf8c0b47d024258ba4 2023-10-30 06:54:47,349 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030dc210fd1a1134fa3bef38f932b251031 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030dc210fd1a1134fa3bef38f932b251031 2023-10-30 06:54:47,349 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310303a5284afcab8411081ce6613ef912e22 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310303a5284afcab8411081ce6613ef912e22 2023-10-30 06:54:47,349 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 06:54:47,349 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231030ff860f014ef44e1087112c5907e73e42 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231030ff860f014ef44e1087112c5907e73e42 2023-10-30 06:54:47,349 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 06:54:47,349 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 06:54:47,349 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 06:54:47,349 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 06:54:47,349 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 06:54:47,349 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310305edcfbddcf684a71835737c85f5bd817 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310305edcfbddcf684a71835737c85f5bd817 2023-10-30 06:54:47,350 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231030f7f635e224be4126ba2ba1be9fcf3e5a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231030f7f635e224be4126ba2ba1be9fcf3e5a 2023-10-30 06:54:47,350 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 06:54:47,350 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030' 2023-10-30 06:54:47,350 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 06:54:47,350 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-10-30 06:54:47,353 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:54:47,355 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:54:47,363 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:54:47,364 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:54:47,371 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:54:47,372 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:54:47,388 INFO [Listener at localhost/40811] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=286 (was 245) - Thread LEAK? -, OpenFileDescriptor=758 (was 609) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=107 (was 163), ProcessCount=167 (was 167), AvailableMemoryMB=2262 (was 2379) 2023-10-30 06:54:47,401 INFO [Listener at localhost/40811] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=286, OpenFileDescriptor=758, MaxFileDescriptor=60000, SystemLoadAverage=107, ProcessCount=167, AvailableMemoryMB=2262 2023-10-30 06:54:47,407 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.HMaster$15(3014): Client=jenkins//148.251.75.209 creating {NAME => 'ns'} 2023-10-30 06:54:47,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-10-30 06:54:47,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-30 06:54:47,415 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-30 06:54:47,417 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 8 msec 2023-10-30 06:54:47,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-30 06:54:47,521 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 06:54:47,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-10-30 06:54:47,524 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 06:54:47,525 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-10-30 06:54:47,525 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 06:54:47,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 06:54:47,528 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546 2023-10-30 06:54:47,528 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2 2023-10-30 06:54:47,528 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf 2023-10-30 06:54:47,529 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546 empty. 2023-10-30 06:54:47,529 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf empty. 2023-10-30 06:54:47,529 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2 empty. 2023-10-30 06:54:47,529 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546 2023-10-30 06:54:47,529 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2 2023-10-30 06:54:47,529 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf 2023-10-30 06:54:47,529 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-10-30 06:54:47,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 06:54:47,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 06:54:47,939 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-10-30 06:54:47,941 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => c3e30d703d05e89f358fe3734d065edf, NAME => 'ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:54:47,941 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0c0f560567c2bce5ddb5cadb54500eb2, NAME => 'ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:54:47,941 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => a0188f6e341e706b75eb054b66e35546, NAME => 'ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:54:48,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 06:54:48,214 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family2/ae1040c07490445bb2952666a09984b1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/ae1040c07490445bb2952666a09984b1 2023-10-30 06:54:48,214 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family1/27ffc0a8257c462ab87bcdf0ada99276 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/27ffc0a8257c462ab87bcdf0ada99276 2023-10-30 06:54:48,219 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in fd2fe0ed654295f84d64a2166ce6f05f/family1 of fd2fe0ed654295f84d64a2166ce6f05f into 27ffc0a8257c462ab87bcdf0ada99276(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:54:48,219 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 570b991da0936dd868ef50ca1259021d/family2 of 570b991da0936dd868ef50ca1259021d into ae1040c07490445bb2952666a09984b1(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:54:48,219 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:48,219 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:48,219 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f., storeName=fd2fe0ed654295f84d64a2166ce6f05f/family1, priority=12, startTime=1698648886166; duration=1sec 2023-10-30 06:54:48,219 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d., storeName=570b991da0936dd868ef50ca1259021d/family2, priority=12, startTime=1698648886252; duration=1sec 2023-10-30 06:54:48,219 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-30 06:54:48,219 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-30 06:54:48,219 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 570b991da0936dd868ef50ca1259021d/family1 in testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:54:48,219 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-10-30 06:54:48,219 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-30 06:54:48,219 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-30 06:54:48,219 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-dc3f481d4da4462b8763896c8e74cbda, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-0133c3bcd7234223b3f1953aa36bf981, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-40770f8b14244f33ab8455fefea8d2ef, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-e9293e91bcc441c3bb7ecbf6ae816e8c] to archive 2023-10-30 06:54:48,219 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. because compaction request was cancelled 2023-10-30 06:54:48,219 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-b95281a1720c482b9ec17a02a87d6b65, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-7f09297a98814e8fb694af5775f3ab6a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-d8eed4b92a704b0792b454c0e5bbae8a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-d952b53beec64936896c3e5e46d2c1e8, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/30cce5de58984a398a62d9ac06aac3eb_SeqId_34_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp, totalSize=28.9 K 2023-10-30 06:54:48,220 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-30 06:54:48,220 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:48,220 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-b95281a1720c482b9ec17a02a87d6b65, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648864029 2023-10-30 06:54:48,221 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-7f09297a98814e8fb694af5775f3ab6a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648865841 2023-10-30 06:54:48,221 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-d8eed4b92a704b0792b454c0e5bbae8a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648867674 2023-10-30 06:54:48,222 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-dc3f481d4da4462b8763896c8e74cbda to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-dc3f481d4da4462b8763896c8e74cbda 2023-10-30 06:54:48,222 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-30 06:54:48,222 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-d952b53beec64936896c3e5e46d2c1e8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648869621 2023-10-30 06:54:48,222 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1912): fd2fe0ed654295f84d64a2166ce6f05f/family2 is initiating minor compaction (all files) 2023-10-30 06:54:48,222 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fd2fe0ed654295f84d64a2166ce6f05f/family2 in testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:54:48,222 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-fca7c332984945bc80b348cc51442c60, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-ab029fd919ee4a8789fc32de37bafa2c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-618962d22cca49e5b9a996d4747b7f1f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-d6922695a3a84331b7d8e02c3b7aa2cb] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp, totalSize=20.4 K 2023-10-30 06:54:48,222 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] compactions.Compactor(207): Compacting 30cce5de58984a398a62d9ac06aac3eb_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1698648864029 2023-10-30 06:54:48,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-0133c3bcd7234223b3f1953aa36bf981 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-0133c3bcd7234223b3f1953aa36bf981 2023-10-30 06:54:48,223 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-fca7c332984945bc80b348cc51442c60, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648864028 2023-10-30 06:54:48,224 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-ab029fd919ee4a8789fc32de37bafa2c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648865841 2023-10-30 06:54:48,224 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-618962d22cca49e5b9a996d4747b7f1f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648867673 2023-10-30 06:54:48,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-40770f8b14244f33ab8455fefea8d2ef to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-40770f8b14244f33ab8455fefea8d2ef 2023-10-30 06:54:48,225 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-d6922695a3a84331b7d8e02c3b7aa2cb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648869619 2023-10-30 06:54:48,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-e9293e91bcc441c3bb7ecbf6ae816e8c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family1/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-e9293e91bcc441c3bb7ecbf6ae816e8c 2023-10-30 06:54:48,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-19947e0cbcef4f759642e84ac7b612ca, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-fd4594129f1249819d49581025e122ab, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-0504fd6f8ad2495d8fbf2f3069916bbf, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-99125cfc1c274a58b5463561f1bd5ea2] to archive 2023-10-30 06:54:48,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:48,230 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-19947e0cbcef4f759642e84ac7b612ca to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-19947e0cbcef4f759642e84ac7b612ca 2023-10-30 06:54:48,232 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-fd4594129f1249819d49581025e122ab to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-fd4594129f1249819d49581025e122ab 2023-10-30 06:54:48,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-0504fd6f8ad2495d8fbf2f3069916bbf to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-0504fd6f8ad2495d8fbf2f3069916bbf 2023-10-30 06:54:48,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-99125cfc1c274a58b5463561f1bd5ea2 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family2/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-99125cfc1c274a58b5463561f1bd5ea2 2023-10-30 06:54:48,237 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] throttle.PressureAwareThroughputController(145): 570b991da0936dd868ef50ca1259021d#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 53.85 MB/second 2023-10-30 06:54:48,242 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): fd2fe0ed654295f84d64a2166ce6f05f#family2#compaction#118 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-30 06:54:48,267 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 06:54:48,346 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:48,346 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing c3e30d703d05e89f358fe3734d065edf, disabling compactions & flushes 2023-10-30 06:54:48,346 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:48,346 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:48,346 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:48,346 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. after waiting 0 ms 2023-10-30 06:54:48,346 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 0c0f560567c2bce5ddb5cadb54500eb2, disabling compactions & flushes 2023-10-30 06:54:48,346 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:48,346 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:48,346 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:48,346 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing a0188f6e341e706b75eb054b66e35546, disabling compactions & flushes 2023-10-30 06:54:48,346 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:48,347 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:48,347 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for c3e30d703d05e89f358fe3734d065edf: 2023-10-30 06:54:48,347 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:48,347 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:48,347 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. after waiting 0 ms 2023-10-30 06:54:48,347 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. after waiting 0 ms 2023-10-30 06:54:48,347 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:48,347 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:48,347 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:48,347 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:48,347 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for a0188f6e341e706b75eb054b66e35546: 2023-10-30 06:54:48,347 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 0c0f560567c2bce5ddb5cadb54500eb2: 2023-10-30 06:54:48,349 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 06:54:48,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698648888350"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648888350"}]},"ts":"1698648888350"} 2023-10-30 06:54:48,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698648888350"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648888350"}]},"ts":"1698648888350"} 2023-10-30 06:54:48,350 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698648888350"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648888350"}]},"ts":"1698648888350"} 2023-10-30 06:54:48,352 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 06:54:48,352 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 06:54:48,353 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648888352"}]},"ts":"1698648888352"} 2023-10-30 06:54:48,354 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-10-30 06:54:48,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a0188f6e341e706b75eb054b66e35546, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0c0f560567c2bce5ddb5cadb54500eb2, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c3e30d703d05e89f358fe3734d065edf, ASSIGN}] 2023-10-30 06:54:48,357 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0c0f560567c2bce5ddb5cadb54500eb2, ASSIGN 2023-10-30 06:54:48,358 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c3e30d703d05e89f358fe3734d065edf, ASSIGN 2023-10-30 06:54:48,358 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a0188f6e341e706b75eb054b66e35546, ASSIGN 2023-10-30 06:54:48,358 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0c0f560567c2bce5ddb5cadb54500eb2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:54:48,358 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c3e30d703d05e89f358fe3734d065edf, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:54:48,358 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a0188f6e341e706b75eb054b66e35546, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:54:48,512 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a0188f6e341e706b75eb054b66e35546, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:48,512 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=c3e30d703d05e89f358fe3734d065edf, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:48,512 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0c0f560567c2bce5ddb5cadb54500eb2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:48,512 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698648888512"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648888512"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648888512"}]},"ts":"1698648888512"} 2023-10-30 06:54:48,512 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698648888512"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648888512"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648888512"}]},"ts":"1698648888512"} 2023-10-30 06:54:48,512 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698648888512"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648888512"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648888512"}]},"ts":"1698648888512"} 2023-10-30 06:54:48,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure a0188f6e341e706b75eb054b66e35546, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:48,515 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure 0c0f560567c2bce5ddb5cadb54500eb2, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:48,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure c3e30d703d05e89f358fe3734d065edf, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:54:48,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 06:54:48,667 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:48,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:48,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0c0f560567c2bce5ddb5cadb54500eb2, NAME => 'ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 06:54:48,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 0c0f560567c2bce5ddb5cadb54500eb2 2023-10-30 06:54:48,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:48,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0c0f560567c2bce5ddb5cadb54500eb2 2023-10-30 06:54:48,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0c0f560567c2bce5ddb5cadb54500eb2 2023-10-30 06:54:48,673 INFO [StoreOpener-0c0f560567c2bce5ddb5cadb54500eb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0c0f560567c2bce5ddb5cadb54500eb2 2023-10-30 06:54:48,675 DEBUG [StoreOpener-0c0f560567c2bce5ddb5cadb54500eb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1 2023-10-30 06:54:48,675 DEBUG [StoreOpener-0c0f560567c2bce5ddb5cadb54500eb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1 2023-10-30 06:54:48,675 INFO [StoreOpener-0c0f560567c2bce5ddb5cadb54500eb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c0f560567c2bce5ddb5cadb54500eb2 columnFamilyName family1 2023-10-30 06:54:48,678 INFO [StoreOpener-0c0f560567c2bce5ddb5cadb54500eb2-1] regionserver.HStore(310): Store=0c0f560567c2bce5ddb5cadb54500eb2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:48,679 INFO [StoreOpener-0c0f560567c2bce5ddb5cadb54500eb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0c0f560567c2bce5ddb5cadb54500eb2 2023-10-30 06:54:48,681 DEBUG [StoreOpener-0c0f560567c2bce5ddb5cadb54500eb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2 2023-10-30 06:54:48,681 DEBUG [StoreOpener-0c0f560567c2bce5ddb5cadb54500eb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2 2023-10-30 06:54:48,682 INFO [StoreOpener-0c0f560567c2bce5ddb5cadb54500eb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c0f560567c2bce5ddb5cadb54500eb2 columnFamilyName family2 2023-10-30 06:54:48,684 INFO [StoreOpener-0c0f560567c2bce5ddb5cadb54500eb2-1] regionserver.HStore(310): Store=0c0f560567c2bce5ddb5cadb54500eb2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:48,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2 2023-10-30 06:54:48,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2 2023-10-30 06:54:48,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:54:48,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0c0f560567c2bce5ddb5cadb54500eb2 2023-10-30 06:54:48,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:54:48,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0c0f560567c2bce5ddb5cadb54500eb2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64145709, jitterRate=-0.04415445029735565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:54:48,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0c0f560567c2bce5ddb5cadb54500eb2: 2023-10-30 06:54:48,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2., pid=110, masterSystemTime=1698648888667 2023-10-30 06:54:48,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:48,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:48,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:48,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a0188f6e341e706b75eb054b66e35546, NAME => 'ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 06:54:48,692 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0c0f560567c2bce5ddb5cadb54500eb2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:48,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction a0188f6e341e706b75eb054b66e35546 2023-10-30 06:54:48,693 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698648888692"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648888692"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648888692"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648888692"}]},"ts":"1698648888692"} 2023-10-30 06:54:48,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:48,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a0188f6e341e706b75eb054b66e35546 2023-10-30 06:54:48,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a0188f6e341e706b75eb054b66e35546 2023-10-30 06:54:48,694 INFO [StoreOpener-a0188f6e341e706b75eb054b66e35546-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a0188f6e341e706b75eb054b66e35546 2023-10-30 06:54:48,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=107 2023-10-30 06:54:48,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure 0c0f560567c2bce5ddb5cadb54500eb2, server=jenkins-hbase20.apache.org,40611,1698648765457 in 179 msec 2023-10-30 06:54:48,696 DEBUG [StoreOpener-a0188f6e341e706b75eb054b66e35546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1 2023-10-30 06:54:48,696 DEBUG [StoreOpener-a0188f6e341e706b75eb054b66e35546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1 2023-10-30 06:54:48,696 INFO [StoreOpener-a0188f6e341e706b75eb054b66e35546-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0188f6e341e706b75eb054b66e35546 columnFamilyName family1 2023-10-30 06:54:48,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0c0f560567c2bce5ddb5cadb54500eb2, ASSIGN in 340 msec 2023-10-30 06:54:48,697 INFO [StoreOpener-a0188f6e341e706b75eb054b66e35546-1] regionserver.HStore(310): Store=a0188f6e341e706b75eb054b66e35546/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:48,697 INFO [StoreOpener-a0188f6e341e706b75eb054b66e35546-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a0188f6e341e706b75eb054b66e35546 2023-10-30 06:54:48,699 DEBUG [StoreOpener-a0188f6e341e706b75eb054b66e35546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2 2023-10-30 06:54:48,699 DEBUG [StoreOpener-a0188f6e341e706b75eb054b66e35546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2 2023-10-30 06:54:48,699 INFO [StoreOpener-a0188f6e341e706b75eb054b66e35546-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0188f6e341e706b75eb054b66e35546 columnFamilyName family2 2023-10-30 06:54:48,700 INFO [StoreOpener-a0188f6e341e706b75eb054b66e35546-1] regionserver.HStore(310): Store=a0188f6e341e706b75eb054b66e35546/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:48,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546 2023-10-30 06:54:48,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546 2023-10-30 06:54:48,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:54:48,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a0188f6e341e706b75eb054b66e35546 2023-10-30 06:54:48,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:54:48,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a0188f6e341e706b75eb054b66e35546; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66652397, jitterRate=-0.006801888346672058}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:54:48,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a0188f6e341e706b75eb054b66e35546: 2023-10-30 06:54:48,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546., pid=109, masterSystemTime=1698648888667 2023-10-30 06:54:48,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:48,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:48,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:48,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3e30d703d05e89f358fe3734d065edf, NAME => 'ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 06:54:48,709 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a0188f6e341e706b75eb054b66e35546, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:48,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction c3e30d703d05e89f358fe3734d065edf 2023-10-30 06:54:48,709 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698648888709"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648888709"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648888709"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648888709"}]},"ts":"1698648888709"} 2023-10-30 06:54:48,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:54:48,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c3e30d703d05e89f358fe3734d065edf 2023-10-30 06:54:48,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c3e30d703d05e89f358fe3734d065edf 2023-10-30 06:54:48,711 INFO [StoreOpener-c3e30d703d05e89f358fe3734d065edf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c3e30d703d05e89f358fe3734d065edf 2023-10-30 06:54:48,713 DEBUG [StoreOpener-c3e30d703d05e89f358fe3734d065edf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1 2023-10-30 06:54:48,713 DEBUG [StoreOpener-c3e30d703d05e89f358fe3734d065edf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1 2023-10-30 06:54:48,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-10-30 06:54:48,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure a0188f6e341e706b75eb054b66e35546, server=jenkins-hbase20.apache.org,40611,1698648765457 in 197 msec 2023-10-30 06:54:48,713 INFO [StoreOpener-c3e30d703d05e89f358fe3734d065edf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3e30d703d05e89f358fe3734d065edf columnFamilyName family1 2023-10-30 06:54:48,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a0188f6e341e706b75eb054b66e35546, ASSIGN in 357 msec 2023-10-30 06:54:48,714 INFO [StoreOpener-c3e30d703d05e89f358fe3734d065edf-1] regionserver.HStore(310): Store=c3e30d703d05e89f358fe3734d065edf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:48,715 INFO [StoreOpener-c3e30d703d05e89f358fe3734d065edf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c3e30d703d05e89f358fe3734d065edf 2023-10-30 06:54:48,716 DEBUG [StoreOpener-c3e30d703d05e89f358fe3734d065edf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2 2023-10-30 06:54:48,716 DEBUG [StoreOpener-c3e30d703d05e89f358fe3734d065edf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2 2023-10-30 06:54:48,717 INFO [StoreOpener-c3e30d703d05e89f358fe3734d065edf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3e30d703d05e89f358fe3734d065edf columnFamilyName family2 2023-10-30 06:54:48,718 INFO [StoreOpener-c3e30d703d05e89f358fe3734d065edf-1] regionserver.HStore(310): Store=c3e30d703d05e89f358fe3734d065edf/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:54:48,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf 2023-10-30 06:54:48,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf 2023-10-30 06:54:48,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:54:48,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c3e30d703d05e89f358fe3734d065edf 2023-10-30 06:54:48,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:54:48,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c3e30d703d05e89f358fe3734d065edf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59296431, jitterRate=-0.11641432344913483}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:54:48,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c3e30d703d05e89f358fe3734d065edf: 2023-10-30 06:54:48,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf., pid=111, masterSystemTime=1698648888667 2023-10-30 06:54:48,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:48,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:48,728 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=c3e30d703d05e89f358fe3734d065edf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:48,728 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698648888728"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648888728"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648888728"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648888728"}]},"ts":"1698648888728"} 2023-10-30 06:54:48,731 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=108 2023-10-30 06:54:48,732 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure c3e30d703d05e89f358fe3734d065edf, server=jenkins-hbase20.apache.org,40611,1698648765457 in 214 msec 2023-10-30 06:54:48,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=105 2023-10-30 06:54:48,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c3e30d703d05e89f358fe3734d065edf, ASSIGN in 376 msec 2023-10-30 06:54:48,734 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 06:54:48,734 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648888734"}]},"ts":"1698648888734"} 2023-10-30 06:54:48,735 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-10-30 06:54:48,737 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 06:54:48,738 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2160 sec 2023-10-30 06:54:49,073 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/.tmp/family2/d164ba9131aa4b27ae489f6dacd11f8c as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/d164ba9131aa4b27ae489f6dacd11f8c 2023-10-30 06:54:49,080 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in fd2fe0ed654295f84d64a2166ce6f05f/family2 of fd2fe0ed654295f84d64a2166ce6f05f into d164ba9131aa4b27ae489f6dacd11f8c(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:54:49,080 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:54:49,080 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f., storeName=fd2fe0ed654295f84d64a2166ce6f05f/family2, priority=12, startTime=1698648886166; duration=0sec 2023-10-30 06:54:49,080 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:54:49,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-fca7c332984945bc80b348cc51442c60, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-ab029fd919ee4a8789fc32de37bafa2c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-618962d22cca49e5b9a996d4747b7f1f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-d6922695a3a84331b7d8e02c3b7aa2cb] to archive 2023-10-30 06:54:49,112 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:49,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-fca7c332984945bc80b348cc51442c60 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-fca7c332984945bc80b348cc51442c60 2023-10-30 06:54:49,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-ab029fd919ee4a8789fc32de37bafa2c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-ab029fd919ee4a8789fc32de37bafa2c 2023-10-30 06:54:49,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-618962d22cca49e5b9a996d4747b7f1f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-618962d22cca49e5b9a996d4747b7f1f 2023-10-30 06:54:49,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-d6922695a3a84331b7d8e02c3b7aa2cb to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/family2/testCompactionWithHFileLink=fd2fe0ed654295f84d64a2166ce6f05f-d6922695a3a84331b7d8e02c3b7aa2cb 2023-10-30 06:54:49,477 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/.tmp/family1/61f93c7ae5e54f9093cbb4df872d7d86 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/61f93c7ae5e54f9093cbb4df872d7d86 2023-10-30 06:54:49,484 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 570b991da0936dd868ef50ca1259021d/family1 of 570b991da0936dd868ef50ca1259021d into 61f93c7ae5e54f9093cbb4df872d7d86(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:54:49,484 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:54:49,484 INFO [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1698648887344; duration=1sec 2023-10-30 06:54:49,484 DEBUG [RS:0;jenkins-hbase20:40611-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:54:49,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-b95281a1720c482b9ec17a02a87d6b65, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-7f09297a98814e8fb694af5775f3ab6a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-d8eed4b92a704b0792b454c0e5bbae8a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-d952b53beec64936896c3e5e46d2c1e8, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/30cce5de58984a398a62d9ac06aac3eb_SeqId_34_] to archive 2023-10-30 06:54:49,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:49,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-b95281a1720c482b9ec17a02a87d6b65 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-b95281a1720c482b9ec17a02a87d6b65 2023-10-30 06:54:49,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-7f09297a98814e8fb694af5775f3ab6a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-7f09297a98814e8fb694af5775f3ab6a 2023-10-30 06:54:49,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-d8eed4b92a704b0792b454c0e5bbae8a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-d8eed4b92a704b0792b454c0e5bbae8a 2023-10-30 06:54:49,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-d952b53beec64936896c3e5e46d2c1e8 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/testCompactionWithHFileLink=570b991da0936dd868ef50ca1259021d-d952b53beec64936896c3e5e46d2c1e8 2023-10-30 06:54:49,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/30cce5de58984a398a62d9ac06aac3eb_SeqId_34_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/family1/30cce5de58984a398a62d9ac06aac3eb_SeqId_34_ 2023-10-30 06:54:49,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 06:54:49,635 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-10-30 06:54:49,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:49,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:49,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:49,651 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:49,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 06:54:49,654 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 06:54:49,654 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:49,654 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 06:54:49,654 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 06:54:49,655 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:49,655 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:49,656 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:49,656 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:49,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:49,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:49,656 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:49,656 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:49,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:49,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:49,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:49,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:49,657 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 06:54:49,657 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 06:54:49,657 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 06:54:49,657 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:49,657 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 06:54:49,658 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:49,658 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. started... 2023-10-30 06:54:49,658 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:49,658 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. started... 2023-10-30 06:54:49,658 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:54:49,660 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0c0f560567c2bce5ddb5cadb54500eb2 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 06:54:49,660 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:49,660 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3e30d703d05e89f358fe3734d065edf 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 06:54:49,660 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:49,660 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. started... 2023-10-30 06:54:49,660 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a0188f6e341e706b75eb054b66e35546 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 06:54:49,693 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030125df67e8ad74d3caed6a17cf485386d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030125df67e8ad74d3caed6a17cf485386d 2023-10-30 06:54:50,084 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310306c270418f1ff46118efc7f41113750ee to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310306c270418f1ff46118efc7f41113750ee 2023-10-30 06:54:50,092 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family1/4ddf4058fba4409d8f05ca7e92fda96c 2023-10-30 06:54:50,096 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030899ee706c36d42519d198b8d1b94e4e1 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231030899ee706c36d42519d198b8d1b94e4e1 2023-10-30 06:54:50,099 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family1/b893e0456037466d9696f436589c8c04 2023-10-30 06:54:50,107 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030c242648291384693a559f5e30e20d4d7 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231030c242648291384693a559f5e30e20d4d7 2023-10-30 06:54:50,111 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family2/80c11b3713a04bee859be606375cc57b 2023-10-30 06:54:50,119 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030e6d838303229475fad94126af7266f95 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231030e6d838303229475fad94126af7266f95 2023-10-30 06:54:50,121 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family1/4ddf4058fba4409d8f05ca7e92fda96c as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/4ddf4058fba4409d8f05ca7e92fda96c 2023-10-30 06:54:50,124 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/4ddf4058fba4409d8f05ca7e92fda96c, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 06:54:50,125 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family2/80c11b3713a04bee859be606375cc57b as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/80c11b3713a04bee859be606375cc57b 2023-10-30 06:54:50,128 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/80c11b3713a04bee859be606375cc57b, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 06:54:50,129 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a0188f6e341e706b75eb054b66e35546 in 469ms, sequenceid=5, compaction requested=false 2023-10-30 06:54:50,129 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-10-30 06:54:50,129 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a0188f6e341e706b75eb054b66e35546: 2023-10-30 06:54:50,129 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:50,130 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:54:50,502 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family1/da9a5a0afd3843a7bf905c5435d4a85c 2023-10-30 06:54:50,524 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family2/e55e44eb6148407eb26f6ddfca4c5c00 2023-10-30 06:54:50,528 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family1/b893e0456037466d9696f436589c8c04 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/b893e0456037466d9696f436589c8c04 2023-10-30 06:54:50,531 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/b893e0456037466d9696f436589c8c04, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 06:54:50,532 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family2/e55e44eb6148407eb26f6ddfca4c5c00 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/e55e44eb6148407eb26f6ddfca4c5c00 2023-10-30 06:54:50,535 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/e55e44eb6148407eb26f6ddfca4c5c00, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 06:54:50,536 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c3e30d703d05e89f358fe3734d065edf in 876ms, sequenceid=5, compaction requested=false 2023-10-30 06:54:50,536 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3e30d703d05e89f358fe3734d065edf: 2023-10-30 06:54:50,537 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:50,537 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:54:50,925 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310302261b70657a246d592c7e058a877f0b5 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202310302261b70657a246d592c7e058a877f0b5 2023-10-30 06:54:51,333 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family2/2968cb8bf70843b88bc6a66aeb7e37d1 2023-10-30 06:54:51,341 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family1/da9a5a0afd3843a7bf905c5435d4a85c as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/da9a5a0afd3843a7bf905c5435d4a85c 2023-10-30 06:54:51,348 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/da9a5a0afd3843a7bf905c5435d4a85c, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 06:54:51,350 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family2/2968cb8bf70843b88bc6a66aeb7e37d1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/2968cb8bf70843b88bc6a66aeb7e37d1 2023-10-30 06:54:51,355 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/2968cb8bf70843b88bc6a66aeb7e37d1, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 06:54:51,356 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0c0f560567c2bce5ddb5cadb54500eb2 in 1696ms, sequenceid=5, compaction requested=false 2023-10-30 06:54:51,357 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0c0f560567c2bce5ddb5cadb54500eb2: 2023-10-30 06:54:51,357 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:51,357 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:54:51,357 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:54:51,357 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,357 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 06:54:51,357 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 06:54:51,359 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,359 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:51,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:51,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:51,359 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:51,359 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:51,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:51,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:51,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:51,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:51,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 06:54:51,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@529c4ea4[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:51,360 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 06:54:51,361 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:51,361 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:51,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:51,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:51,361 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 06:54:51,361 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 06:54:51,361 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:51,361 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,362 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:51,362 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 06:54:51,362 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:51,362 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 06:54:51,362 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:51,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:51,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 06:54:51,365 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 06:54:51,365 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:51,365 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:51,365 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 06:54:51,365 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:51,366 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:51,366 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:51,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:51,366 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:51,366 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:51,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:51,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:51,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:51,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:51,367 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:51,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:51,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:51,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,369 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,369 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:51,369 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:51,369 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:51,369 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:51,369 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,369 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 06:54:51,369 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:51,369 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:51,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:51,369 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-30 06:54:51,369 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:51,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:51,369 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:51,369 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:51,370 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:51,370 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:51,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:51,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:51,470 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:51,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:51,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:51,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:51,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:51,480 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:51,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:51,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 06:54:51,483 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 06:54:51,483 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:51,483 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 06:54:51,483 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 06:54:51,484 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:51,484 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:51,485 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:51,485 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:51,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:51,485 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:51,485 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:51,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:51,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:51,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:51,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:51,486 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 06:54:51,486 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-30 06:54:51,486 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 06:54:51,486 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 06:54:51,486 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:51,486 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 06:54:51,486 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:51,487 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:51,487 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:54:51,487 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:51,487 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. started... 2023-10-30 06:54:51,487 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:51,487 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. started... 2023-10-30 06:54:51,487 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. started... 2023-10-30 06:54:51,487 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3e30d703d05e89f358fe3734d065edf 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 06:54:51,487 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a0188f6e341e706b75eb054b66e35546 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 06:54:51,487 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0c0f560567c2bce5ddb5cadb54500eb2 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 06:54:51,502 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310309869e31a48fd4e21ad1a72fdee9e1c03 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310309869e31a48fd4e21ad1a72fdee9e1c03 2023-10-30 06:54:51,902 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030ce929247fcf34ace84013c71e8d980ca to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030ce929247fcf34ace84013c71e8d980ca 2023-10-30 06:54:51,902 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310302a7801c07323440dbf2305b7cd30afe5 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310302a7801c07323440dbf2305b7cd30afe5 2023-10-30 06:54:51,906 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family1/b644c3a22c1543f488abc3ca49897143 2023-10-30 06:54:52,307 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family1/99f2d121da65413f9dd0a18f986d4466 2023-10-30 06:54:52,307 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family1/0c3dd9c8f6d84450b767dede71f73faf 2023-10-30 06:54:52,318 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030611af211fcef4b75bff66e5be1ef149e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231030611af211fcef4b75bff66e5be1ef149e 2023-10-30 06:54:52,331 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family2/d219e46b6c054ba0b2658baeebe163e0 2023-10-30 06:54:52,333 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310307d10cfce54444015be590e4f72badfd8 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202310307d10cfce54444015be590e4f72badfd8 2023-10-30 06:54:52,334 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family1/b644c3a22c1543f488abc3ca49897143 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/b644c3a22c1543f488abc3ca49897143 2023-10-30 06:54:52,338 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/b644c3a22c1543f488abc3ca49897143, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 06:54:52,339 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family2/d219e46b6c054ba0b2658baeebe163e0 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/d219e46b6c054ba0b2658baeebe163e0 2023-10-30 06:54:52,342 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/d219e46b6c054ba0b2658baeebe163e0, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 06:54:52,343 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0c0f560567c2bce5ddb5cadb54500eb2 in 856ms, sequenceid=9, compaction requested=false 2023-10-30 06:54:52,343 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0c0f560567c2bce5ddb5cadb54500eb2: 2023-10-30 06:54:52,343 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:52,343 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:54:52,735 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030b45fae68d2cd479b9af0dd596d4f06fa to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231030b45fae68d2cd479b9af0dd596d4f06fa 2023-10-30 06:54:52,738 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family2/889a4b87c594435399870d85dd940e25 2023-10-30 06:54:52,743 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family2/d534c38da61b4c8f990cc979390b8531 2023-10-30 06:54:52,745 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family1/0c3dd9c8f6d84450b767dede71f73faf as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/0c3dd9c8f6d84450b767dede71f73faf 2023-10-30 06:54:52,748 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family1/99f2d121da65413f9dd0a18f986d4466 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/99f2d121da65413f9dd0a18f986d4466 2023-10-30 06:54:52,750 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/0c3dd9c8f6d84450b767dede71f73faf, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 06:54:52,751 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family2/889a4b87c594435399870d85dd940e25 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/889a4b87c594435399870d85dd940e25 2023-10-30 06:54:52,753 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/99f2d121da65413f9dd0a18f986d4466, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 06:54:52,754 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family2/d534c38da61b4c8f990cc979390b8531 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/d534c38da61b4c8f990cc979390b8531 2023-10-30 06:54:52,755 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/889a4b87c594435399870d85dd940e25, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 06:54:52,756 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c3e30d703d05e89f358fe3734d065edf in 1269ms, sequenceid=9, compaction requested=false 2023-10-30 06:54:52,756 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3e30d703d05e89f358fe3734d065edf: 2023-10-30 06:54:52,756 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:52,756 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:54:52,757 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/d534c38da61b4c8f990cc979390b8531, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 06:54:52,758 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a0188f6e341e706b75eb054b66e35546 in 1271ms, sequenceid=9, compaction requested=false 2023-10-30 06:54:52,758 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a0188f6e341e706b75eb054b66e35546: 2023-10-30 06:54:52,758 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:52,758 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:54:52,758 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:54:52,758 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,758 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 06:54:52,758 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 06:54:52,760 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,760 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:52,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:52,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:52,761 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:52,761 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:52,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:52,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:52,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:52,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:52,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 06:54:52,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21d270ea[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:52,762 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 06:54:52,762 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:52,762 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:52,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:52,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:52,763 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 06:54:52,763 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 06:54:52,763 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,763 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:52,763 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:52,764 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 06:54:52,764 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,764 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:52,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:52,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:52,764 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 06:54:52,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:52,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:52,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:52,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:52,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:52,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:52,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 06:54:52,765 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 06:54:52,765 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:52,765 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:52,765 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 06:54:52,765 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:52,766 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:52,766 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:52,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:52,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:52,766 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:52,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:52,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:52,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:52,767 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:52,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:52,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:52,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:52,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:52,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:52,768 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:52,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:52,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:52,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,769 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:52,769 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,769 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 06:54:52,769 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:52,769 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:52,769 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:52,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:52,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:52,769 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:52,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-30 06:54:52,769 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:52,769 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:52,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:52,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:52,770 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,770 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:52,770 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:52,770 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:52,770 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:52,870 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:52,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:52,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:52,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:52,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:52,877 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:52,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:52,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 06:54:52,880 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 06:54:52,880 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:52,880 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 06:54:52,880 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 06:54:52,881 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:52,881 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:52,882 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,882 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:52,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:52,883 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:52,883 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:52,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:52,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:52,884 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 06:54:52,885 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-30 06:54:52,885 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 06:54:52,885 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 06:54:52,885 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:52,885 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 06:54:52,885 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:52,885 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. started... 2023-10-30 06:54:52,885 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:52,885 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. started... 2023-10-30 06:54:52,885 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:54:52,886 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0c0f560567c2bce5ddb5cadb54500eb2 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 06:54:52,886 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:52,885 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:52,886 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. started... 2023-10-30 06:54:52,885 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3e30d703d05e89f358fe3734d065edf 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 06:54:52,886 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a0188f6e341e706b75eb054b66e35546 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 06:54:52,905 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310309f34f6a7d4cb4035800e096b8e69e125 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310309f34f6a7d4cb4035800e096b8e69e125 2023-10-30 06:54:52,905 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030a84dddde970c4f258ce88b4ae70e5fa1 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231030a84dddde970c4f258ce88b4ae70e5fa1 2023-10-30 06:54:53,305 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030ded7331cc47e40f7a26028b28ad8682b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030ded7331cc47e40f7a26028b28ad8682b 2023-10-30 06:54:53,312 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family1/a50e41cd929642eba542670d2d6fa064 2023-10-30 06:54:53,312 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family1/4ef7c233db11415b939beef0b0c33c0d 2023-10-30 06:54:53,710 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family1/9544f9db22cf4452b71d0ceb535e5c6f 2023-10-30 06:54:53,740 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030b5202b8d6d97446baeba1191d3c6899c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231030b5202b8d6d97446baeba1191d3c6899c 2023-10-30 06:54:53,740 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030da73bd4436d543b19a2e5ea5168339d8 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231030da73bd4436d543b19a2e5ea5168339d8 2023-10-30 06:54:54,130 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310301198a786de66498b875d8a10decf5da8 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202310301198a786de66498b875d8a10decf5da8 2023-10-30 06:54:54,141 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family2/66d7db16043d40bfb635320709411553 2023-10-30 06:54:54,146 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family2/a966e6b7c93946329855f6179f9dcf62 2023-10-30 06:54:54,147 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family2/8fd9f023301747cf81369fc0882d0b74 2023-10-30 06:54:54,155 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family1/9544f9db22cf4452b71d0ceb535e5c6f as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/9544f9db22cf4452b71d0ceb535e5c6f 2023-10-30 06:54:54,164 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family1/4ef7c233db11415b939beef0b0c33c0d as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/4ef7c233db11415b939beef0b0c33c0d 2023-10-30 06:54:54,164 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family1/a50e41cd929642eba542670d2d6fa064 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/a50e41cd929642eba542670d2d6fa064 2023-10-30 06:54:54,167 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/9544f9db22cf4452b71d0ceb535e5c6f, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 06:54:54,170 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/a50e41cd929642eba542670d2d6fa064, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 06:54:54,170 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family2/66d7db16043d40bfb635320709411553 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/66d7db16043d40bfb635320709411553 2023-10-30 06:54:54,172 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family2/8fd9f023301747cf81369fc0882d0b74 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/8fd9f023301747cf81369fc0882d0b74 2023-10-30 06:54:54,173 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 06:54:54,175 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/4ef7c233db11415b939beef0b0c33c0d, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 06:54:54,176 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family2/a966e6b7c93946329855f6179f9dcf62 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/a966e6b7c93946329855f6179f9dcf62 2023-10-30 06:54:54,179 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/8fd9f023301747cf81369fc0882d0b74, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 06:54:54,193 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/a966e6b7c93946329855f6179f9dcf62, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 06:54:54,194 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a0188f6e341e706b75eb054b66e35546 in 1308ms, sequenceid=13, compaction requested=true 2023-10-30 06:54:54,194 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a0188f6e341e706b75eb054b66e35546: 2023-10-30 06:54:54,194 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:54,194 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:54:54,194 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0c0f560567c2bce5ddb5cadb54500eb2 in 1308ms, sequenceid=13, compaction requested=true 2023-10-30 06:54:54,195 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0c0f560567c2bce5ddb5cadb54500eb2: 2023-10-30 06:54:54,195 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:54,195 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:54:54,198 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/66d7db16043d40bfb635320709411553, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 06:54:54,199 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c3e30d703d05e89f358fe3734d065edf in 1314ms, sequenceid=13, compaction requested=true 2023-10-30 06:54:54,199 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3e30d703d05e89f358fe3734d065edf: 2023-10-30 06:54:54,199 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:54,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:54:54,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:54:54,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 06:54:54,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 06:54:54,201 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:54,201 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:54,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:54,201 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:54,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:54,201 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:54,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:54,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:54,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:54,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 06:54:54,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f42b17e[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:54,203 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 06:54:54,203 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:54,207 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:54,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:54,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:54,207 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 06:54:54,207 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 06:54:54,207 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:54,212 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,212 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:54,220 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 06:54:54,221 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:54,221 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 06:54:54,229 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:54,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:54,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:54,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:54,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:54,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:54,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:54,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:54,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 06:54:54,233 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 06:54:54,233 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:54,233 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:54,233 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 06:54:54,233 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:54,234 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:54,234 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:54,234 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:54,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:54,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:54,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:54,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:54,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:54,234 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:54,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:54,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:54,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:54,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:54,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:54,236 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:54,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:54,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:54,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,238 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,238 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:54,238 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:54,238 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,238 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:54,238 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:54,238 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:54,238 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 06:54:54,238 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:54,238 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:54,238 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:54,238 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:54,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-30 06:54:54,242 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:54,242 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:54,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:54,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:54,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:54,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:54,338 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:54,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:54,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:54,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:54,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:54:54,342 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:54,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:54,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 06:54:54,347 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 06:54:54,347 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:54,347 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 06:54:54,347 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 06:54:54,355 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:54,355 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:54,356 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:54,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:54,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:54,356 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:54,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:54,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:54,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:54,357 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 06:54:54,358 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-30 06:54:54,358 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 06:54:54,358 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 06:54:54,358 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:54,358 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 06:54:54,359 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:54,359 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:54,366 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:54,366 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. started... 2023-10-30 06:54:54,367 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:54,367 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. started... 2023-10-30 06:54:54,367 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3e30d703d05e89f358fe3734d065edf 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 06:54:54,367 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0c0f560567c2bce5ddb5cadb54500eb2 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 06:54:54,370 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:54:54,370 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:54,372 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:54,373 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. started... 2023-10-30 06:54:54,373 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a0188f6e341e706b75eb054b66e35546 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 06:54:54,413 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030ce40433f37854a7b8713b4a348f8efe6 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231030ce40433f37854a7b8713b4a348f8efe6 2023-10-30 06:54:54,420 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310304b584c13b3d34f7baf85e8d22b6fbb28 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310304b584c13b3d34f7baf85e8d22b6fbb28 2023-10-30 06:54:54,816 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030c2b0f31966ac47d78a8120f2d781356d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030c2b0f31966ac47d78a8120f2d781356d 2023-10-30 06:54:54,834 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family1/7b2b418db23e40e289bab08c23ab83e4 2023-10-30 06:54:54,834 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family1/fbc00040aca447cfb84f700c2aa1de10 2023-10-30 06:54:54,855 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310308ba49c551060422ea0b7dfc0a221a2db to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202310308ba49c551060422ea0b7dfc0a221a2db 2023-10-30 06:54:54,855 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310302d99753b6f99442a964b258595695268 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202310302d99753b6f99442a964b258595695268 2023-10-30 06:54:54,861 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family2/1bdfddebfd684491b82e54cc601b2575 2023-10-30 06:54:54,863 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family2/f4d78ef3d96b429483a52504ed93ddc8 2023-10-30 06:54:54,865 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family1/fbc00040aca447cfb84f700c2aa1de10 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/fbc00040aca447cfb84f700c2aa1de10 2023-10-30 06:54:54,869 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family1/7b2b418db23e40e289bab08c23ab83e4 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/7b2b418db23e40e289bab08c23ab83e4 2023-10-30 06:54:54,875 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/fbc00040aca447cfb84f700c2aa1de10, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 06:54:54,883 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family2/1bdfddebfd684491b82e54cc601b2575 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/1bdfddebfd684491b82e54cc601b2575 2023-10-30 06:54:54,886 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/7b2b418db23e40e289bab08c23ab83e4, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 06:54:54,887 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family2/f4d78ef3d96b429483a52504ed93ddc8 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/f4d78ef3d96b429483a52504ed93ddc8 2023-10-30 06:54:54,888 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/1bdfddebfd684491b82e54cc601b2575, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 06:54:54,889 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a0188f6e341e706b75eb054b66e35546 in 516ms, sequenceid=17, compaction requested=true 2023-10-30 06:54:54,889 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a0188f6e341e706b75eb054b66e35546: 2023-10-30 06:54:54,889 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:54,889 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:54:54,893 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/f4d78ef3d96b429483a52504ed93ddc8, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 06:54:54,899 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0c0f560567c2bce5ddb5cadb54500eb2 in 532ms, sequenceid=17, compaction requested=true 2023-10-30 06:54:54,899 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0c0f560567c2bce5ddb5cadb54500eb2: 2023-10-30 06:54:54,899 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:54,899 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:54:55,225 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family1/97d5d7ee263149508951185879921f43 2023-10-30 06:54:55,651 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310309bd4091c732847dea5cad3b1368b9b20 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202310309bd4091c732847dea5cad3b1368b9b20 2023-10-30 06:54:56,059 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family2/e360bf9ddb1a459cbce23906882ecacd 2023-10-30 06:54:56,063 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family1/97d5d7ee263149508951185879921f43 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/97d5d7ee263149508951185879921f43 2023-10-30 06:54:56,070 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/97d5d7ee263149508951185879921f43, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 06:54:56,071 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family2/e360bf9ddb1a459cbce23906882ecacd as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/e360bf9ddb1a459cbce23906882ecacd 2023-10-30 06:54:56,076 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/e360bf9ddb1a459cbce23906882ecacd, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 06:54:56,077 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c3e30d703d05e89f358fe3734d065edf in 1710ms, sequenceid=17, compaction requested=true 2023-10-30 06:54:56,077 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3e30d703d05e89f358fe3734d065edf: 2023-10-30 06:54:56,077 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:56,077 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:54:56,077 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:54:56,077 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,077 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 06:54:56,078 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 06:54:56,078 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,078 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:56,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:56,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:56,079 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:56,079 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:56,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:56,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:56,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:56,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:56,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 06:54:56,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69c7f21f[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:56,080 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 06:54:56,080 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:56,081 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:56,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:56,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:56,081 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 06:54:56,081 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 06:54:56,081 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,081 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:56,081 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:56,081 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,081 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 06:54:56,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:56,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:56,082 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:56,082 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 06:54:56,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:56,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:56,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:56,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:56,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:56,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:56,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 06:54:56,084 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 06:54:56,084 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:56,084 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:56,084 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 06:54:56,084 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:56,085 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:56,085 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:56,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:56,085 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:56,085 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:56,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:56,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:56,086 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:56,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:56,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,087 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,087 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:56,087 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:56,087 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,087 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:56,087 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 06:54:56,087 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:56,087 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:56,087 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:56,087 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:56,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-30 06:54:56,087 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:56,087 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:56,088 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:56,088 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:56,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:56,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:56,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:56,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:56,188 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:56,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:56,203 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:54:56,224 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:54:56,235 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:54:56,236 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:54:56,278 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:54:56,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-30 06:54:56,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 06:54:56,282 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 06:54:56,282 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:56,282 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 06:54:56,282 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 06:54:56,283 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:56,283 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:56,284 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:56,284 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:56,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:56,285 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:56,285 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:54:56,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:56,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:56,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:54:56,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:56,287 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 06:54:56,287 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-30 06:54:56,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 06:54:56,287 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 06:54:56,287 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:54:56,287 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 06:54:56,288 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:56,288 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. started... 2023-10-30 06:54:56,288 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:56,288 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3e30d703d05e89f358fe3734d065edf 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 06:54:56,288 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. started... 2023-10-30 06:54:56,288 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0c0f560567c2bce5ddb5cadb54500eb2 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 06:54:56,288 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:54:56,288 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:54:56,288 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:56,289 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. started... 2023-10-30 06:54:56,289 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing a0188f6e341e706b75eb054b66e35546 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 06:54:56,731 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family1/bebbbb4932a941dcaff30d36dc2a1aea 2023-10-30 06:54:56,735 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family1/964da6949ab74ae88a26673edea42655 2023-10-30 06:54:56,738 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bebbbb4932a941dcaff30d36dc2a1aea 2023-10-30 06:54:56,742 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 964da6949ab74ae88a26673edea42655 2023-10-30 06:54:56,757 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family2/8fe55c5e03ce43fe9bb47e69bedaf19f 2023-10-30 06:54:56,763 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8fe55c5e03ce43fe9bb47e69bedaf19f 2023-10-30 06:54:56,764 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family1/964da6949ab74ae88a26673edea42655 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/964da6949ab74ae88a26673edea42655 2023-10-30 06:54:56,768 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 964da6949ab74ae88a26673edea42655 2023-10-30 06:54:56,768 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/964da6949ab74ae88a26673edea42655, entries=3, sequenceid=23, filesize=5.0 K 2023-10-30 06:54:56,768 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family2/8fe55c5e03ce43fe9bb47e69bedaf19f as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/8fe55c5e03ce43fe9bb47e69bedaf19f 2023-10-30 06:54:56,774 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8fe55c5e03ce43fe9bb47e69bedaf19f 2023-10-30 06:54:56,774 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/8fe55c5e03ce43fe9bb47e69bedaf19f, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 06:54:56,775 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c3e30d703d05e89f358fe3734d065edf in 487ms, sequenceid=23, compaction requested=true 2023-10-30 06:54:56,775 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3e30d703d05e89f358fe3734d065edf: 2023-10-30 06:54:56,775 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:56,775 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:54:57,135 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family1/d558911bdb3f424eb913bf8ff02a6120 2023-10-30 06:54:57,140 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d558911bdb3f424eb913bf8ff02a6120 2023-10-30 06:54:57,161 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family2/3fdb9c3dd883472eb574b31b77c6277a 2023-10-30 06:54:57,168 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3fdb9c3dd883472eb574b31b77c6277a 2023-10-30 06:54:57,168 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family1/bebbbb4932a941dcaff30d36dc2a1aea as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/bebbbb4932a941dcaff30d36dc2a1aea 2023-10-30 06:54:57,171 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bebbbb4932a941dcaff30d36dc2a1aea 2023-10-30 06:54:57,171 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/bebbbb4932a941dcaff30d36dc2a1aea, entries=3, sequenceid=23, filesize=5.0 K 2023-10-30 06:54:57,172 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family2/3fdb9c3dd883472eb574b31b77c6277a as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/3fdb9c3dd883472eb574b31b77c6277a 2023-10-30 06:54:57,179 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3fdb9c3dd883472eb574b31b77c6277a 2023-10-30 06:54:57,179 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/3fdb9c3dd883472eb574b31b77c6277a, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 06:54:57,180 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a0188f6e341e706b75eb054b66e35546 in 891ms, sequenceid=23, compaction requested=true 2023-10-30 06:54:57,180 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for a0188f6e341e706b75eb054b66e35546: 2023-10-30 06:54:57,180 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:54:57,180 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:54:57,565 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family2/28a39b98c0184c0b9bae654f41dd1ff2 2023-10-30 06:54:57,569 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28a39b98c0184c0b9bae654f41dd1ff2 2023-10-30 06:54:57,570 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family1/d558911bdb3f424eb913bf8ff02a6120 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/d558911bdb3f424eb913bf8ff02a6120 2023-10-30 06:54:57,577 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d558911bdb3f424eb913bf8ff02a6120 2023-10-30 06:54:57,577 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/d558911bdb3f424eb913bf8ff02a6120, entries=3, sequenceid=23, filesize=5.0 K 2023-10-30 06:54:57,579 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family2/28a39b98c0184c0b9bae654f41dd1ff2 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/28a39b98c0184c0b9bae654f41dd1ff2 2023-10-30 06:54:57,591 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28a39b98c0184c0b9bae654f41dd1ff2 2023-10-30 06:54:57,591 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/28a39b98c0184c0b9bae654f41dd1ff2, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 06:54:57,591 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0c0f560567c2bce5ddb5cadb54500eb2 in 1303ms, sequenceid=23, compaction requested=true 2023-10-30 06:54:57,592 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0c0f560567c2bce5ddb5cadb54500eb2: 2023-10-30 06:54:57,592 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:57,592 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:54:57,592 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:54:57,592 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:57,592 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 06:54:57,592 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 06:54:57,593 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:57,593 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:57,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:57,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:57,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:57,593 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:57,593 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:54:57,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:57,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:57,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:57,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:57,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:57,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 06:54:57,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@599e78ed[Count = 0] remaining members to acquire global barrier 2023-10-30 06:54:57,594 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 06:54:57,594 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:57,596 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:57,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:57,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:57,596 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 06:54:57,596 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 06:54:57,596 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:54:57,596 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:57,597 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:54:57,597 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 06:54:57,597 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:57,597 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:57,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:57,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:57,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:57,597 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 06:54:57,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:57,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:57,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:57,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:57,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:57,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:57,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:57,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:54:57,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 06:54:57,599 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 06:54:57,599 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:54:57,599 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:54:57,599 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 06:54:57,599 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:54:57,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:57,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:57,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:57,600 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:57,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:57,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:57,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:54:57,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:54:57,601 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:57,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:54:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:54:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:57,601 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:57,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:57,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:54:57,603 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:57,603 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:54:57,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:54:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:54:57,603 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:57,603 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 06:54:57,603 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:54:57,603 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 06:54:57,603 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:54:57,603 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:54:57,603 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:54:57,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:54:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:54:57,603 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:57,604 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 06:54:57,604 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 06:54:57,603 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 06:54:57,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 06:54:57,604 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:54:57,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-30 06:54:57,704 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:54:57,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:54:57,705 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:54:57,705 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): c3e30d703d05e89f358fe3734d065edf/family1 is initiating major compaction (all files) 2023-10-30 06:54:57,706 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:54:57,706 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:54:57,706 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of c3e30d703d05e89f358fe3734d065edf/family1 in ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:57,706 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/b893e0456037466d9696f436589c8c04, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/0c3dd9c8f6d84450b767dede71f73faf, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/9544f9db22cf4452b71d0ceb535e5c6f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/97d5d7ee263149508951185879921f43, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/964da6949ab74ae88a26673edea42655] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp, totalSize=26.6 K 2023-10-30 06:54:57,708 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting b893e0456037466d9696f436589c8c04, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648889648 2023-10-30 06:54:57,708 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 0c3dd9c8f6d84450b767dede71f73faf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648891475 2023-10-30 06:54:57,709 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 9544f9db22cf4452b71d0ceb535e5c6f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648892873 2023-10-30 06:54:57,709 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 97d5d7ee263149508951185879921f43, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648894340 2023-10-30 06:54:57,710 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 964da6949ab74ae88a26673edea42655, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 06:54:57,726 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): c3e30d703d05e89f358fe3734d065edf#family1#compaction#149 average throughput is 0.41 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:54:58,143 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231030afeab3f8f65a47a38e840566f652dea8_del 2023-10-30 06:54:58,143 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030afeab3f8f65a47a38e840566f652dea8_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030afeab3f8f65a47a38e840566f652dea8_del 2023-10-30 06:54:58,968 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 246ce02fafcb4d24a79eceacce50c941 2023-10-30 06:54:58,970 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family1/246ce02fafcb4d24a79eceacce50c941 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/246ce02fafcb4d24a79eceacce50c941 2023-10-30 06:54:58,983 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 246ce02fafcb4d24a79eceacce50c941 2023-10-30 06:54:58,984 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c3e30d703d05e89f358fe3734d065edf/family1 of c3e30d703d05e89f358fe3734d065edf into 246ce02fafcb4d24a79eceacce50c941(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:54:58,984 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for c3e30d703d05e89f358fe3734d065edf: 2023-10-30 06:54:58,985 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:54:58,985 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): c3e30d703d05e89f358fe3734d065edf/family2 is initiating major compaction (all files) 2023-10-30 06:54:58,985 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:54:58,985 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:54:58,987 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of c3e30d703d05e89f358fe3734d065edf/family2 in ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:54:58,987 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/e55e44eb6148407eb26f6ddfca4c5c00, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/889a4b87c594435399870d85dd940e25, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/66d7db16043d40bfb635320709411553, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/e360bf9ddb1a459cbce23906882ecacd, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/8fe55c5e03ce43fe9bb47e69bedaf19f] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp, totalSize=25.3 K 2023-10-30 06:54:58,989 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting e55e44eb6148407eb26f6ddfca4c5c00, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648889648 2023-10-30 06:54:58,989 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 889a4b87c594435399870d85dd940e25, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648891475 2023-10-30 06:54:58,990 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 66d7db16043d40bfb635320709411553, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648892873 2023-10-30 06:54:58,990 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting e360bf9ddb1a459cbce23906882ecacd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648894340 2023-10-30 06:54:58,990 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 8fe55c5e03ce43fe9bb47e69bedaf19f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 06:54:59,004 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): c3e30d703d05e89f358fe3734d065edf#family2#compaction#150 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:54:59,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/b893e0456037466d9696f436589c8c04, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/0c3dd9c8f6d84450b767dede71f73faf, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/9544f9db22cf4452b71d0ceb535e5c6f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/97d5d7ee263149508951185879921f43, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/964da6949ab74ae88a26673edea42655] to archive 2023-10-30 06:54:59,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:59,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/b893e0456037466d9696f436589c8c04 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/b893e0456037466d9696f436589c8c04 2023-10-30 06:54:59,012 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310303cd35649ffb14c809c852332929263ae_del 2023-10-30 06:54:59,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/0c3dd9c8f6d84450b767dede71f73faf to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/0c3dd9c8f6d84450b767dede71f73faf 2023-10-30 06:54:59,012 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310303cd35649ffb14c809c852332929263ae_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202310303cd35649ffb14c809c852332929263ae_del 2023-10-30 06:54:59,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/9544f9db22cf4452b71d0ceb535e5c6f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/9544f9db22cf4452b71d0ceb535e5c6f 2023-10-30 06:54:59,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/97d5d7ee263149508951185879921f43 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/97d5d7ee263149508951185879921f43 2023-10-30 06:54:59,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/964da6949ab74ae88a26673edea42655 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/964da6949ab74ae88a26673edea42655 2023-10-30 06:54:59,426 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9df92629c0c49b2b506dc011964f708 2023-10-30 06:54:59,427 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/.tmp/family2/d9df92629c0c49b2b506dc011964f708 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/d9df92629c0c49b2b506dc011964f708 2023-10-30 06:54:59,430 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9df92629c0c49b2b506dc011964f708 2023-10-30 06:54:59,432 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c3e30d703d05e89f358fe3734d065edf/family2 of c3e30d703d05e89f358fe3734d065edf into d9df92629c0c49b2b506dc011964f708(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:54:59,432 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for c3e30d703d05e89f358fe3734d065edf: 2023-10-30 06:54:59,432 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:54:59,432 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): 0c0f560567c2bce5ddb5cadb54500eb2/family1 is initiating major compaction (all files) 2023-10-30 06:54:59,432 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:54:59,432 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:54:59,437 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of 0c0f560567c2bce5ddb5cadb54500eb2/family1 in ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:54:59,437 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/da9a5a0afd3843a7bf905c5435d4a85c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/b644c3a22c1543f488abc3ca49897143, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/4ef7c233db11415b939beef0b0c33c0d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/7b2b418db23e40e289bab08c23ab83e4, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/d558911bdb3f424eb913bf8ff02a6120] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp, totalSize=26.6 K 2023-10-30 06:54:59,438 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting da9a5a0afd3843a7bf905c5435d4a85c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648889648 2023-10-30 06:54:59,438 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting b644c3a22c1543f488abc3ca49897143, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648891475 2023-10-30 06:54:59,439 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 4ef7c233db11415b939beef0b0c33c0d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648892873 2023-10-30 06:54:59,440 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 7b2b418db23e40e289bab08c23ab83e4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648894340 2023-10-30 06:54:59,441 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting d558911bdb3f424eb913bf8ff02a6120, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 06:54:59,450 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): 0c0f560567c2bce5ddb5cadb54500eb2#family1#compaction#151 average throughput is 1.65 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:54:59,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/e55e44eb6148407eb26f6ddfca4c5c00, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/889a4b87c594435399870d85dd940e25, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/66d7db16043d40bfb635320709411553, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/e360bf9ddb1a459cbce23906882ecacd, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/8fe55c5e03ce43fe9bb47e69bedaf19f] to archive 2023-10-30 06:54:59,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:54:59,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/e55e44eb6148407eb26f6ddfca4c5c00 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/e55e44eb6148407eb26f6ddfca4c5c00 2023-10-30 06:54:59,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/889a4b87c594435399870d85dd940e25 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/889a4b87c594435399870d85dd940e25 2023-10-30 06:54:59,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/66d7db16043d40bfb635320709411553 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/66d7db16043d40bfb635320709411553 2023-10-30 06:54:59,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/e360bf9ddb1a459cbce23906882ecacd to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/e360bf9ddb1a459cbce23906882ecacd 2023-10-30 06:54:59,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/8fe55c5e03ce43fe9bb47e69bedaf19f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family2/8fe55c5e03ce43fe9bb47e69bedaf19f 2023-10-30 06:54:59,858 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023103010d1a77ccc74479abf42009e1c997ed0_del 2023-10-30 06:54:59,858 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103010d1a77ccc74479abf42009e1c997ed0_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023103010d1a77ccc74479abf42009e1c997ed0_del 2023-10-30 06:55:00,280 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9d93a82e3e54632ab31e42fe9a3888a 2023-10-30 06:55:00,281 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family1/e9d93a82e3e54632ab31e42fe9a3888a as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/e9d93a82e3e54632ab31e42fe9a3888a 2023-10-30 06:55:00,285 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9d93a82e3e54632ab31e42fe9a3888a 2023-10-30 06:55:00,286 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0c0f560567c2bce5ddb5cadb54500eb2/family1 of 0c0f560567c2bce5ddb5cadb54500eb2 into e9d93a82e3e54632ab31e42fe9a3888a(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:55:00,286 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for 0c0f560567c2bce5ddb5cadb54500eb2: 2023-10-30 06:55:00,286 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:55:00,286 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): 0c0f560567c2bce5ddb5cadb54500eb2/family2 is initiating major compaction (all files) 2023-10-30 06:55:00,286 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:55:00,286 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:55:00,287 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of 0c0f560567c2bce5ddb5cadb54500eb2/family2 in ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:55:00,287 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/2968cb8bf70843b88bc6a66aeb7e37d1, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/d219e46b6c054ba0b2658baeebe163e0, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/a966e6b7c93946329855f6179f9dcf62, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/f4d78ef3d96b429483a52504ed93ddc8, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/28a39b98c0184c0b9bae654f41dd1ff2] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp, totalSize=25.3 K 2023-10-30 06:55:00,288 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 2968cb8bf70843b88bc6a66aeb7e37d1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648889648 2023-10-30 06:55:00,288 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting d219e46b6c054ba0b2658baeebe163e0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648891475 2023-10-30 06:55:00,288 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting a966e6b7c93946329855f6179f9dcf62, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648892873 2023-10-30 06:55:00,289 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting f4d78ef3d96b429483a52504ed93ddc8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648894340 2023-10-30 06:55:00,289 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 28a39b98c0184c0b9bae654f41dd1ff2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 06:55:00,301 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): 0c0f560567c2bce5ddb5cadb54500eb2#family2#compaction#152 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:55:00,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/da9a5a0afd3843a7bf905c5435d4a85c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/b644c3a22c1543f488abc3ca49897143, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/4ef7c233db11415b939beef0b0c33c0d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/7b2b418db23e40e289bab08c23ab83e4, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/d558911bdb3f424eb913bf8ff02a6120] to archive 2023-10-30 06:55:00,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:00,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/da9a5a0afd3843a7bf905c5435d4a85c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/da9a5a0afd3843a7bf905c5435d4a85c 2023-10-30 06:55:00,314 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030a01896081fce4b1389ddfa4df81588b0_del 2023-10-30 06:55:00,314 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030a01896081fce4b1389ddfa4df81588b0_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231030a01896081fce4b1389ddfa4df81588b0_del 2023-10-30 06:55:00,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/b644c3a22c1543f488abc3ca49897143 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/b644c3a22c1543f488abc3ca49897143 2023-10-30 06:55:00,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/4ef7c233db11415b939beef0b0c33c0d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/4ef7c233db11415b939beef0b0c33c0d 2023-10-30 06:55:00,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/7b2b418db23e40e289bab08c23ab83e4 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/7b2b418db23e40e289bab08c23ab83e4 2023-10-30 06:55:00,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/d558911bdb3f424eb913bf8ff02a6120 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/d558911bdb3f424eb913bf8ff02a6120 2023-10-30 06:55:00,747 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b8f2adf924df42af8e6c6ccaa15c1467 2023-10-30 06:55:00,748 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/.tmp/family2/b8f2adf924df42af8e6c6ccaa15c1467 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/b8f2adf924df42af8e6c6ccaa15c1467 2023-10-30 06:55:00,756 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b8f2adf924df42af8e6c6ccaa15c1467 2023-10-30 06:55:00,757 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0c0f560567c2bce5ddb5cadb54500eb2/family2 of 0c0f560567c2bce5ddb5cadb54500eb2 into b8f2adf924df42af8e6c6ccaa15c1467(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:55:00,757 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for 0c0f560567c2bce5ddb5cadb54500eb2: 2023-10-30 06:55:00,757 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:55:00,757 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): a0188f6e341e706b75eb054b66e35546/family1 is initiating major compaction (all files) 2023-10-30 06:55:00,757 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:55:00,758 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:55:00,758 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of a0188f6e341e706b75eb054b66e35546/family1 in ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:55:00,758 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/4ddf4058fba4409d8f05ca7e92fda96c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/99f2d121da65413f9dd0a18f986d4466, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/a50e41cd929642eba542670d2d6fa064, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/fbc00040aca447cfb84f700c2aa1de10, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/bebbbb4932a941dcaff30d36dc2a1aea] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp, totalSize=26.6 K 2023-10-30 06:55:00,761 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 4ddf4058fba4409d8f05ca7e92fda96c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648889647 2023-10-30 06:55:00,762 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 99f2d121da65413f9dd0a18f986d4466, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648891474 2023-10-30 06:55:00,762 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting a50e41cd929642eba542670d2d6fa064, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648892873 2023-10-30 06:55:00,763 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting fbc00040aca447cfb84f700c2aa1de10, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648894340 2023-10-30 06:55:00,764 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting bebbbb4932a941dcaff30d36dc2a1aea, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 06:55:00,787 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): a0188f6e341e706b75eb054b66e35546#family1#compaction#153 average throughput is 0.41 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:55:00,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/2968cb8bf70843b88bc6a66aeb7e37d1, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/d219e46b6c054ba0b2658baeebe163e0, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/a966e6b7c93946329855f6179f9dcf62, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/f4d78ef3d96b429483a52504ed93ddc8, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/28a39b98c0184c0b9bae654f41dd1ff2] to archive 2023-10-30 06:55:00,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:00,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/2968cb8bf70843b88bc6a66aeb7e37d1 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/2968cb8bf70843b88bc6a66aeb7e37d1 2023-10-30 06:55:00,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/d219e46b6c054ba0b2658baeebe163e0 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/d219e46b6c054ba0b2658baeebe163e0 2023-10-30 06:55:00,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/a966e6b7c93946329855f6179f9dcf62 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/a966e6b7c93946329855f6179f9dcf62 2023-10-30 06:55:00,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/f4d78ef3d96b429483a52504ed93ddc8 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/f4d78ef3d96b429483a52504ed93ddc8 2023-10-30 06:55:00,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/28a39b98c0184c0b9bae654f41dd1ff2 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family2/28a39b98c0184c0b9bae654f41dd1ff2 2023-10-30 06:55:01,208 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023103026bc17c7ab4f4aba9e642dce0d3afcfb_del 2023-10-30 06:55:01,208 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103026bc17c7ab4f4aba9e642dce0d3afcfb_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023103026bc17c7ab4f4aba9e642dce0d3afcfb_del 2023-10-30 06:55:02,030 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2bdad43c6c584971b7225e5094255bcb 2023-10-30 06:55:02,032 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family1/2bdad43c6c584971b7225e5094255bcb as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/2bdad43c6c584971b7225e5094255bcb 2023-10-30 06:55:02,040 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2bdad43c6c584971b7225e5094255bcb 2023-10-30 06:55:02,042 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a0188f6e341e706b75eb054b66e35546/family1 of a0188f6e341e706b75eb054b66e35546 into 2bdad43c6c584971b7225e5094255bcb(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:55:02,042 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for a0188f6e341e706b75eb054b66e35546: 2023-10-30 06:55:02,042 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:55:02,042 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): a0188f6e341e706b75eb054b66e35546/family2 is initiating major compaction (all files) 2023-10-30 06:55:02,042 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:55:02,042 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:55:02,042 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of a0188f6e341e706b75eb054b66e35546/family2 in ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:55:02,042 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/80c11b3713a04bee859be606375cc57b, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/d534c38da61b4c8f990cc979390b8531, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/8fd9f023301747cf81369fc0882d0b74, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/1bdfddebfd684491b82e54cc601b2575, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/3fdb9c3dd883472eb574b31b77c6277a] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp, totalSize=25.3 K 2023-10-30 06:55:02,043 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 80c11b3713a04bee859be606375cc57b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648889647 2023-10-30 06:55:02,044 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting d534c38da61b4c8f990cc979390b8531, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648891474 2023-10-30 06:55:02,044 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 8fd9f023301747cf81369fc0882d0b74, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648892873 2023-10-30 06:55:02,045 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 1bdfddebfd684491b82e54cc601b2575, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648894340 2023-10-30 06:55:02,045 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 3fdb9c3dd883472eb574b31b77c6277a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 06:55:02,057 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): a0188f6e341e706b75eb054b66e35546#family2#compaction#154 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:55:02,110 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/4ddf4058fba4409d8f05ca7e92fda96c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/99f2d121da65413f9dd0a18f986d4466, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/a50e41cd929642eba542670d2d6fa064, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/fbc00040aca447cfb84f700c2aa1de10, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/bebbbb4932a941dcaff30d36dc2a1aea] to archive 2023-10-30 06:55:02,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:02,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/4ddf4058fba4409d8f05ca7e92fda96c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/4ddf4058fba4409d8f05ca7e92fda96c 2023-10-30 06:55:02,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/99f2d121da65413f9dd0a18f986d4466 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/99f2d121da65413f9dd0a18f986d4466 2023-10-30 06:55:02,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/a50e41cd929642eba542670d2d6fa064 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/a50e41cd929642eba542670d2d6fa064 2023-10-30 06:55:02,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/fbc00040aca447cfb84f700c2aa1de10 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/fbc00040aca447cfb84f700c2aa1de10 2023-10-30 06:55:02,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/bebbbb4932a941dcaff30d36dc2a1aea to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/bebbbb4932a941dcaff30d36dc2a1aea 2023-10-30 06:55:02,476 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310302e41f1b528cc4328a3cf5c1deaa1746d_del 2023-10-30 06:55:02,476 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310302e41f1b528cc4328a3cf5c1deaa1746d_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202310302e41f1b528cc4328a3cf5c1deaa1746d_del 2023-10-30 06:55:03,304 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c1370c254bd44eb8e0ebb3d33208c35 2023-10-30 06:55:03,305 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/.tmp/family2/6c1370c254bd44eb8e0ebb3d33208c35 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/6c1370c254bd44eb8e0ebb3d33208c35 2023-10-30 06:55:03,313 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c1370c254bd44eb8e0ebb3d33208c35 2023-10-30 06:55:03,314 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a0188f6e341e706b75eb054b66e35546/family2 of a0188f6e341e706b75eb054b66e35546 into 6c1370c254bd44eb8e0ebb3d33208c35(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:55:03,314 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for a0188f6e341e706b75eb054b66e35546: 2023-10-30 06:55:03,318 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:55:03,322 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:55:03,326 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:55:03,328 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:55:03,335 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 06:55:03,353 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-10-30 06:55:03,356 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023103026bc17c7ab4f4aba9e642dce0d3afcfb_del 2023-10-30 06:55:03,358 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023103010d1a77ccc74479abf42009e1c997ed0_del 2023-10-30 06:55:03,361 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231030afeab3f8f65a47a38e840566f652dea8_del 2023-10-30 06:55:03,361 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-10-30 06:55:03,362 DEBUG [Listener at localhost/40811] zookeeper.ReadOnlyZKClient(139): Connect 0x28f6fa48 to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:55:03,366 DEBUG [Listener at localhost/40811] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2079ecd2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:55:03,367 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 06:55:03,367 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 06:55:03,367 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 06:55:03,393 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310301dbbd490b5864a05842803671b167055 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202310301dbbd490b5864a05842803671b167055 2023-10-30 06:55:03,394 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 06:55:03,404 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:55:03,406 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:55:03,413 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:55:03,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/80c11b3713a04bee859be606375cc57b, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/d534c38da61b4c8f990cc979390b8531, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/8fd9f023301747cf81369fc0882d0b74, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/1bdfddebfd684491b82e54cc601b2575, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/3fdb9c3dd883472eb574b31b77c6277a] to archive 2023-10-30 06:55:03,417 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:55:03,417 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:03,419 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/80c11b3713a04bee859be606375cc57b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/80c11b3713a04bee859be606375cc57b 2023-10-30 06:55:03,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/d534c38da61b4c8f990cc979390b8531 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/d534c38da61b4c8f990cc979390b8531 2023-10-30 06:55:03,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/8fd9f023301747cf81369fc0882d0b74 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/8fd9f023301747cf81369fc0882d0b74 2023-10-30 06:55:03,422 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/1bdfddebfd684491b82e54cc601b2575 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/1bdfddebfd684491b82e54cc601b2575 2023-10-30 06:55:03,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/3fdb9c3dd883472eb574b31b77c6277a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family2/3fdb9c3dd883472eb574b31b77c6277a 2023-10-30 06:55:03,426 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030/family1/c97742f6b67c43aaaa598b758e340cf6 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-10-30 06:55:03,427 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030/family1/c97742f6b67c43aaaa598b758e340cf6}] 2023-10-30 06:55:03,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030/family1/c97742f6b67c43aaaa598b758e340cf6 for inclusion in c3e30d703d05e89f358fe3734d065edf/family1 2023-10-30 06:55:03,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-10-30 06:55:03,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 06:55:03,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for c3e30d703d05e89f358fe3734d065edf: 2023-10-30 06:55:03,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030/family1/c97742f6b67c43aaaa598b758e340cf6 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__8nnv07guk8glr117dkh15g01g392996fkjslt0bs01mbeq2q84aa92efnvrv9kdf/family1/c97742f6b67c43aaaa598b758e340cf6 2023-10-30 06:55:03,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__8nnv07guk8glr117dkh15g01g392996fkjslt0bs01mbeq2q84aa92efnvrv9kdf/family1/c97742f6b67c43aaaa598b758e340cf6 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/80f7833201ba4277bfac207691e54ca2_SeqId_28_ 2023-10-30 06:55:03,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__8nnv07guk8glr117dkh15g01g392996fkjslt0bs01mbeq2q84aa92efnvrv9kdf/family1/c97742f6b67c43aaaa598b758e340cf6 into c3e30d703d05e89f358fe3734d065edf/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/80f7833201ba4277bfac207691e54ca2_SeqId_28_ - updating store file list. 2023-10-30 06:55:03,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/80f7833201ba4277bfac207691e54ca2_SeqId_28_ into c3e30d703d05e89f358fe3734d065edf/family1 2023-10-30 06:55:03,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__8nnv07guk8glr117dkh15g01g392996fkjslt0bs01mbeq2q84aa92efnvrv9kdf/family1/c97742f6b67c43aaaa598b758e340cf6 into c3e30d703d05e89f358fe3734d065edf/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/family1/80f7833201ba4277bfac207691e54ca2_SeqId_28_) 2023-10-30 06:55:03,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__8nnv07guk8glr117dkh15g01g392996fkjslt0bs01mbeq2q84aa92efnvrv9kdf/family1/c97742f6b67c43aaaa598b758e340cf6 2023-10-30 06:55:03,444 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 06:55:03,445 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:03,446 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030125df67e8ad74d3caed6a17cf485386d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030125df67e8ad74d3caed6a17cf485386d 2023-10-30 06:55:03,446 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-30 06:55:03,446 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 06:55:03,447 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 06:55:04,206 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030332624535a11435e8e60d280e25df669 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231030332624535a11435e8e60d280e25df669 2023-10-30 06:55:04,206 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030f19f8d448f6d49b7a9befc6ed0efda0d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231030f19f8d448f6d49b7a9befc6ed0efda0d 2023-10-30 06:55:04,207 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 06:55:04,208 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 06:55:04,235 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030/family1/ec700c213e6849b0b12cc8eb716f7ac9 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-10-30 06:55:04,235 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/family1/391e52e7bed74f889266b1efd9eed5ab first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-10-30 06:55:04,236 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030/family1/ec700c213e6849b0b12cc8eb716f7ac9}] 2023-10-30 06:55:04,236 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/family1/391e52e7bed74f889266b1efd9eed5ab}] 2023-10-30 06:55:04,238 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/family1/391e52e7bed74f889266b1efd9eed5ab for inclusion in a0188f6e341e706b75eb054b66e35546/family1 2023-10-30 06:55:04,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030/family1/ec700c213e6849b0b12cc8eb716f7ac9 for inclusion in 0c0f560567c2bce5ddb5cadb54500eb2/family1 2023-10-30 06:55:04,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-10-30 06:55:04,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-10-30 06:55:04,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-30 06:55:04,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last=1 2023-10-30 06:55:04,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 0c0f560567c2bce5ddb5cadb54500eb2: 2023-10-30 06:55:04,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for a0188f6e341e706b75eb054b66e35546: 2023-10-30 06:55:04,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/family1/391e52e7bed74f889266b1efd9eed5ab to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__bt0ncdl4fnck21fnksb41gdrdgb9n1r8jvco25mv6jfsvuk4oj6kmcopjhqtmo1d/family1/391e52e7bed74f889266b1efd9eed5ab 2023-10-30 06:55:04,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030/family1/ec700c213e6849b0b12cc8eb716f7ac9 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__vj7uj5lfnqrfidnek128vea6glpjfmrdsdtp1ro6qc069tkaqdrn3kg3dlfpcplo/family1/ec700c213e6849b0b12cc8eb716f7ac9 2023-10-30 06:55:04,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__bt0ncdl4fnck21fnksb41gdrdgb9n1r8jvco25mv6jfsvuk4oj6kmcopjhqtmo1d/family1/391e52e7bed74f889266b1efd9eed5ab as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/ed4e04ef4e5e4d2b993c611c0a52e3d8_SeqId_28_ 2023-10-30 06:55:04,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__vj7uj5lfnqrfidnek128vea6glpjfmrdsdtp1ro6qc069tkaqdrn3kg3dlfpcplo/family1/ec700c213e6849b0b12cc8eb716f7ac9 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/578154eea908420fb0e660d4b5970804_SeqId_28_ 2023-10-30 06:55:04,244 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__bt0ncdl4fnck21fnksb41gdrdgb9n1r8jvco25mv6jfsvuk4oj6kmcopjhqtmo1d/family1/391e52e7bed74f889266b1efd9eed5ab into a0188f6e341e706b75eb054b66e35546/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/ed4e04ef4e5e4d2b993c611c0a52e3d8_SeqId_28_ - updating store file list. 2023-10-30 06:55:04,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__vj7uj5lfnqrfidnek128vea6glpjfmrdsdtp1ro6qc069tkaqdrn3kg3dlfpcplo/family1/ec700c213e6849b0b12cc8eb716f7ac9 into 0c0f560567c2bce5ddb5cadb54500eb2/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/578154eea908420fb0e660d4b5970804_SeqId_28_ - updating store file list. 2023-10-30 06:55:04,258 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:55:04,258 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70a40077 to 127.0.0.1:50449 2023-10-30 06:55:04,258 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/ed4e04ef4e5e4d2b993c611c0a52e3d8_SeqId_28_ into a0188f6e341e706b75eb054b66e35546/family1 2023-10-30 06:55:04,258 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__bt0ncdl4fnck21fnksb41gdrdgb9n1r8jvco25mv6jfsvuk4oj6kmcopjhqtmo1d/family1/391e52e7bed74f889266b1efd9eed5ab into a0188f6e341e706b75eb054b66e35546/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/family1/ed4e04ef4e5e4d2b993c611c0a52e3d8_SeqId_28_) 2023-10-30 06:55:04,258 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:55:04,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/578154eea908420fb0e660d4b5970804_SeqId_28_ into 0c0f560567c2bce5ddb5cadb54500eb2/family1 2023-10-30 06:55:04,258 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:55:04,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__vj7uj5lfnqrfidnek128vea6glpjfmrdsdtp1ro6qc069tkaqdrn3kg3dlfpcplo/family1/ec700c213e6849b0b12cc8eb716f7ac9 into 0c0f560567c2bce5ddb5cadb54500eb2/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/family1/578154eea908420fb0e660d4b5970804_SeqId_28_) 2023-10-30 06:55:04,259 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c5f3021 to 127.0.0.1:50449 2023-10-30 06:55:04,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__bt0ncdl4fnck21fnksb41gdrdgb9n1r8jvco25mv6jfsvuk4oj6kmcopjhqtmo1d/family1/391e52e7bed74f889266b1efd9eed5ab 2023-10-30 06:55:04,259 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:55:04,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__ns_testMinorCompaction__vj7uj5lfnqrfidnek128vea6glpjfmrdsdtp1ro6qc069tkaqdrn3kg3dlfpcplo/family1/ec700c213e6849b0b12cc8eb716f7ac9 2023-10-30 06:55:04,261 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 06:55:04,261 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 06:55:04,261 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:04,261 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:04,262 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310306c270418f1ff46118efc7f41113750ee to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310306c270418f1ff46118efc7f41113750ee 2023-10-30 06:55:04,262 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-30 06:55:04,262 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231030899ee706c36d42519d198b8d1b94e4e1 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231030899ee706c36d42519d198b8d1b94e4e1 2023-10-30 06:55:04,262 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 06:55:04,262 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-30 06:55:04,262 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030' 2023-10-30 06:55:04,263 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 06:55:04,263 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 06:55:04,263 INFO [Listener at localhost/40811] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-10-30 06:55:04,265 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:55:04,267 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:55:04,269 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:55:04,270 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:55:04,284 INFO [Listener at localhost/40811] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=258 (was 286), OpenFileDescriptor=647 (was 758), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=163 (was 107) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=2232 (was 2262) 2023-10-30 06:55:04,294 INFO [Listener at localhost/40811] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=258, OpenFileDescriptor=646, MaxFileDescriptor=60000, SystemLoadAverage=163, ProcessCount=167, AvailableMemoryMB=2232 2023-10-30 06:55:04,296 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 06:55:04,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:04,298 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 06:55:04,298 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-10-30 06:55:04,298 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 06:55:04,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 06:55:04,300 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb 2023-10-30 06:55:04,300 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb empty. 2023-10-30 06:55:04,301 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb 2023-10-30 06:55:04,301 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-10-30 06:55:04,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 06:55:04,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 06:55:04,709 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-30 06:55:04,711 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => c9cc40ce683e8c632aae150d7ae235fb, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:55:04,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 06:55:05,123 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:55:05,123 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing c9cc40ce683e8c632aae150d7ae235fb, disabling compactions & flushes 2023-10-30 06:55:05,123 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:05,123 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:05,123 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. after waiting 0 ms 2023-10-30 06:55:05,124 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:05,124 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:05,124 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:05,130 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 06:55:05,132 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698648905132"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648905132"}]},"ts":"1698648905132"} 2023-10-30 06:55:05,135 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 06:55:05,135 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 06:55:05,135 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648905135"}]},"ts":"1698648905135"} 2023-10-30 06:55:05,136 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-10-30 06:55:05,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=c9cc40ce683e8c632aae150d7ae235fb, ASSIGN}] 2023-10-30 06:55:05,140 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=c9cc40ce683e8c632aae150d7ae235fb, ASSIGN 2023-10-30 06:55:05,140 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=c9cc40ce683e8c632aae150d7ae235fb, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:55:05,292 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=c9cc40ce683e8c632aae150d7ae235fb, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:05,292 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698648905292"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648905292"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648905292"}]},"ts":"1698648905292"} 2023-10-30 06:55:05,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure c9cc40ce683e8c632aae150d7ae235fb, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:55:05,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 06:55:05,446 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:05,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:05,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c9cc40ce683e8c632aae150d7ae235fb, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb.', STARTKEY => '', ENDKEY => ''} 2023-10-30 06:55:05,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy c9cc40ce683e8c632aae150d7ae235fb 2023-10-30 06:55:05,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:55:05,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c9cc40ce683e8c632aae150d7ae235fb 2023-10-30 06:55:05,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c9cc40ce683e8c632aae150d7ae235fb 2023-10-30 06:55:05,458 INFO [StoreOpener-c9cc40ce683e8c632aae150d7ae235fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c9cc40ce683e8c632aae150d7ae235fb 2023-10-30 06:55:05,461 DEBUG [StoreOpener-c9cc40ce683e8c632aae150d7ae235fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1 2023-10-30 06:55:05,462 DEBUG [StoreOpener-c9cc40ce683e8c632aae150d7ae235fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1 2023-10-30 06:55:05,462 INFO [StoreOpener-c9cc40ce683e8c632aae150d7ae235fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9cc40ce683e8c632aae150d7ae235fb columnFamilyName family1 2023-10-30 06:55:05,465 INFO [StoreOpener-c9cc40ce683e8c632aae150d7ae235fb-1] regionserver.HStore(310): Store=c9cc40ce683e8c632aae150d7ae235fb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:55:05,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb 2023-10-30 06:55:05,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb 2023-10-30 06:55:05,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c9cc40ce683e8c632aae150d7ae235fb 2023-10-30 06:55:05,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:55:05,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c9cc40ce683e8c632aae150d7ae235fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69874920, jitterRate=0.04121744632720947}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 06:55:05,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:05,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb., pid=114, masterSystemTime=1698648905446 2023-10-30 06:55:05,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:05,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:05,475 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=c9cc40ce683e8c632aae150d7ae235fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:05,476 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698648905475"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648905475"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648905475"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648905475"}]},"ts":"1698648905475"} 2023-10-30 06:55:05,478 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-10-30 06:55:05,479 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure c9cc40ce683e8c632aae150d7ae235fb, server=jenkins-hbase20.apache.org,40611,1698648765457 in 183 msec 2023-10-30 06:55:05,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-10-30 06:55:05,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=c9cc40ce683e8c632aae150d7ae235fb, ASSIGN in 341 msec 2023-10-30 06:55:05,481 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 06:55:05,481 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648905481"}]},"ts":"1698648905481"} 2023-10-30 06:55:05,482 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-10-30 06:55:05,484 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 06:55:05,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1880 sec 2023-10-30 06:55:06,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 06:55:06,407 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-10-30 06:55:06,430 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:06,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:06,431 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:06,431 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:06,431 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:55:06,431 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:55:06,432 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:06,432 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:06,433 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:06,433 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:06,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:06,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:06,433 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:06,433 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:06,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:06,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:06,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:06,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:06,434 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:06,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:06,434 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:55:06,434 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:06,434 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:55:06,434 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:55:06,434 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:06,434 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:06,434 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. started... 2023-10-30 06:55:06,435 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c9cc40ce683e8c632aae150d7ae235fb 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 06:55:06,862 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113050de856c5cca486b870057ea3f1cf965 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113050de856c5cca486b870057ea3f1cf965 2023-10-30 06:55:07,268 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/5229578e3f144901a68f0addb4494054 2023-10-30 06:55:07,280 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/5229578e3f144901a68f0addb4494054 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/5229578e3f144901a68f0addb4494054 2023-10-30 06:55:07,285 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/5229578e3f144901a68f0addb4494054, entries=1000, sequenceid=5, filesize=166.0 K 2023-10-30 06:55:07,286 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c9cc40ce683e8c632aae150d7ae235fb in 851ms, sequenceid=5, compaction requested=false 2023-10-30 06:55:07,286 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:07,287 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:07,287 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:07,287 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:55:07,287 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:55:07,287 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,287 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:55:07,287 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:55:07,289 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,289 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:07,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:07,289 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,289 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:07,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:07,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:07,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:07,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:55:07,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bf91614[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:07,292 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:55:07,292 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,293 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,293 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:55:07,294 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:55:07,294 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:07,294 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,294 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:07,295 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:55:07,295 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,295 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:07,295 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:55:07,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:07,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:07,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:07,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:07,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:07,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:07,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:55:07,299 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:55:07,299 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:07,300 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:07,300 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,300 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:07,303 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,303 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:07,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:07,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,303 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:07,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:07,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:07,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:07,304 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:07,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,306 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:07,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,314 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:07,314 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,314 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,314 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:07,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:55:07,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:07,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:07,314 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:07,314 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:07,315 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:07,314 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,315 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,315 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:07,315 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:07,315 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:07,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:07,315 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,316 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,416 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:07,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:07,428 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:07,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:55:07,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,431 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:07,431 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:07,432 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:55:07,432 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:55:07,432 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,432 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,434 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,434 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:07,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:07,434 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:07,434 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,436 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,437 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:55:07,437 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:07,437 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:55:07,437 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:07,437 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:55:07,437 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:55:07,437 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:07,437 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:07,437 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. started... 2023-10-30 06:55:07,437 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c9cc40ce683e8c632aae150d7ae235fb 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 06:55:07,862 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287d11029c8546430c84665bfe1c7c180d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511287d11029c8546430c84665bfe1c7c180d 2023-10-30 06:55:08,270 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/5d964a0342294c1c899d426a2b4647a4 2023-10-30 06:55:08,282 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/5d964a0342294c1c899d426a2b4647a4 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/5d964a0342294c1c899d426a2b4647a4 2023-10-30 06:55:08,288 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/5d964a0342294c1c899d426a2b4647a4, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 06:55:08,289 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c9cc40ce683e8c632aae150d7ae235fb in 852ms, sequenceid=9, compaction requested=false 2023-10-30 06:55:08,289 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:08,289 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:08,289 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:55:08,289 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:55:08,289 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,289 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:55:08,289 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:55:08,291 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,291 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:08,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:08,291 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:08,291 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:08,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:08,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:08,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:55:08,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61ba8354[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:08,293 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:55:08,293 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,294 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,294 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:55:08,294 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:55:08,294 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,294 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:08,294 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:08,295 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:55:08,295 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,295 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:08,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:08,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:08,295 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:55:08,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:08,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:08,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:08,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:08,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:55:08,299 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:55:08,299 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:08,299 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:08,299 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,299 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:08,300 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,300 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:08,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:08,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,300 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:08,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:08,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:08,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:08,301 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:08,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,303 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:08,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,306 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,306 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:08,306 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:08,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:08,306 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:08,307 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:08,307 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:08,307 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:08,307 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,307 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,307 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,307 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,307 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:08,307 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:08,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:08,307 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:08,408 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:08,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:08,420 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:08,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:55:08,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,422 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:08,422 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:08,422 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:55:08,422 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:55:08,423 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,423 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,424 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,424 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:08,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:08,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:08,425 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:08,425 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:08,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:08,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,426 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:55:08,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:08,426 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:55:08,426 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:08,426 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:55:08,427 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:55:08,427 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:08,427 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:08,427 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. started... 2023-10-30 06:55:08,427 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c9cc40ce683e8c632aae150d7ae235fb 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:55:08,849 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120184c68388c3314c4596d94a702e8472be to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120184c68388c3314c4596d94a702e8472be 2023-10-30 06:55:09,257 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/ebd7b3b26f374887b7f95750cc1bdf98 2023-10-30 06:55:09,267 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/ebd7b3b26f374887b7f95750cc1bdf98 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ebd7b3b26f374887b7f95750cc1bdf98 2023-10-30 06:55:09,273 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ebd7b3b26f374887b7f95750cc1bdf98, entries=1, sequenceid=13, filesize=4.9 K 2023-10-30 06:55:09,274 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c9cc40ce683e8c632aae150d7ae235fb in 847ms, sequenceid=13, compaction requested=true 2023-10-30 06:55:09,274 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:09,274 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:09,274 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:55:09,274 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:55:09,274 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,274 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:55:09,274 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:55:09,276 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,276 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:09,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:09,276 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,277 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:09,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:09,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:09,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:09,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:55:09,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37bbd276[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:09,278 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:55:09,278 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,279 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,279 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:55:09,279 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:55:09,279 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:09,279 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,280 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:09,281 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:55:09,281 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,281 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:09,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:09,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:09,281 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:55:09,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:09,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:09,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:09,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:09,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:55:09,284 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:55:09,284 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:09,284 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:09,284 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,284 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:09,286 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,286 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:09,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:09,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,286 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:09,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:09,287 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:09,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:09,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:09,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,289 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:09,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,292 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,292 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:09,292 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,292 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:09,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:09,292 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:09,292 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:09,292 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:09,292 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:09,292 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,292 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:09,292 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:09,292 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,293 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:09,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:09,293 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,393 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:09,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:09,397 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:09,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:55:09,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,398 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:09,398 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:09,399 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:55:09,399 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:55:09,399 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,399 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,400 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:09,400 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:09,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:09,400 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:09,400 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:09,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:09,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,401 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,401 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:55:09,401 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:09,402 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:55:09,402 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:09,402 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:55:09,402 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:55:09,402 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:09,402 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:09,402 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. started... 2023-10-30 06:55:09,402 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c9cc40ce683e8c632aae150d7ae235fb 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:55:09,824 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512050aa6490bf275425f8246f28600da672a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512050aa6490bf275425f8246f28600da672a 2023-10-30 06:55:10,233 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/f252bf887b0d4ea3991cfd5861028d15 2023-10-30 06:55:10,246 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/f252bf887b0d4ea3991cfd5861028d15 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/f252bf887b0d4ea3991cfd5861028d15 2023-10-30 06:55:10,255 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/f252bf887b0d4ea3991cfd5861028d15, entries=1, sequenceid=17, filesize=4.9 K 2023-10-30 06:55:10,256 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c9cc40ce683e8c632aae150d7ae235fb in 854ms, sequenceid=17, compaction requested=true 2023-10-30 06:55:10,256 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:10,256 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:10,256 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:55:10,256 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:55:10,256 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,256 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:55:10,256 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:55:10,258 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,258 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:10,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:10,258 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,258 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:10,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:10,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:10,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:10,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:55:10,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dc89d7c[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:10,261 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:55:10,261 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,262 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,262 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:55:10,262 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:55:10,262 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:10,262 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,262 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:10,263 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:55:10,263 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,263 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:10,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:10,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:10,263 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:55:10,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:10,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:10,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:10,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:10,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:55:10,265 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:55:10,265 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:10,265 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:10,265 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,265 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:10,266 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,266 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:10,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:10,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,266 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:10,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:10,267 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,268 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:10,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,269 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,269 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:10,269 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,269 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:10,269 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:10,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:10,269 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:10,269 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:10,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:10,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:55:10,269 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,269 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:10,269 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:10,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:10,269 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:10,269 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,269 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,269 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,369 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:10,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:10,381 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:10,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:55:10,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,385 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:10,385 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:10,385 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:55:10,385 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:55:10,386 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,386 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,387 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,387 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:10,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:10,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:10,388 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:10,388 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:10,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:10,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,389 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,389 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:55:10,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:10,389 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:55:10,389 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:10,389 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:55:10,389 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:55:10,389 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:10,389 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:10,389 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. started... 2023-10-30 06:55:10,389 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c9cc40ce683e8c632aae150d7ae235fb 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:55:10,806 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228fe1a39ee4ea7432bbd1a34b47f0bde3f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228fe1a39ee4ea7432bbd1a34b47f0bde3f 2023-10-30 06:55:10,994 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 06:55:11,213 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/f2ebcaa77cb34aa4926cc74a81df2f9d 2023-10-30 06:55:11,218 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/f2ebcaa77cb34aa4926cc74a81df2f9d as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/f2ebcaa77cb34aa4926cc74a81df2f9d 2023-10-30 06:55:11,222 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/f2ebcaa77cb34aa4926cc74a81df2f9d, entries=1, sequenceid=21, filesize=4.9 K 2023-10-30 06:55:11,223 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c9cc40ce683e8c632aae150d7ae235fb in 834ms, sequenceid=21, compaction requested=true 2023-10-30 06:55:11,223 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:11,223 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:11,224 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:55:11,224 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:55:11,224 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,224 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:55:11,224 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:55:11,225 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,225 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:11,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:11,226 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,226 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:11,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:11,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:11,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:11,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:55:11,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ea26167[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:11,228 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:55:11,228 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,228 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,229 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:55:11,229 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:55:11,229 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:11,229 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,229 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:11,230 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:55:11,230 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,230 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:11,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:11,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:11,230 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:55:11,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:11,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:11,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:11,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:11,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:55:11,233 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:55:11,233 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:11,233 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:11,234 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,234 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:11,236 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,236 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:11,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:11,236 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:11,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:11,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:11,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:11,237 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:11,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,239 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:11,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,241 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,241 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:11,241 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,241 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:11,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:11,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:11,241 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:11,241 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:11,242 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:11,241 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,242 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,242 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:11,242 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,242 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:11,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:11,242 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:11,242 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,343 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:11,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:11,355 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:11,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:55:11,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,359 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:11,359 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:11,359 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:55:11,359 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:55:11,360 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,360 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,361 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,361 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:11,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:11,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:11,361 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:11,361 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:11,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:11,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,363 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,363 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:55:11,363 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:11,363 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:55:11,363 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:11,363 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:55:11,363 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:55:11,363 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:11,363 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:11,363 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. started... 2023-10-30 06:55:11,364 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c9cc40ce683e8c632aae150d7ae235fb 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:55:11,778 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f58babb433fc4ed68e5f0a9b25d0c3de to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231f58babb433fc4ed68e5f0a9b25d0c3de 2023-10-30 06:55:12,189 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/4eeed5008504458cb945760393e1f1e1 2023-10-30 06:55:12,193 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/4eeed5008504458cb945760393e1f1e1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/4eeed5008504458cb945760393e1f1e1 2023-10-30 06:55:12,197 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/4eeed5008504458cb945760393e1f1e1, entries=1, sequenceid=25, filesize=4.9 K 2023-10-30 06:55:12,198 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c9cc40ce683e8c632aae150d7ae235fb in 835ms, sequenceid=25, compaction requested=true 2023-10-30 06:55:12,198 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:12,198 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:12,198 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:55:12,198 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:55:12,198 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,198 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:55:12,198 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:55:12,199 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:12,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:12,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,199 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:12,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:12,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:12,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:12,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:55:12,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bb7e5c4[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:12,200 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:55:12,201 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,201 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,201 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:55:12,201 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,201 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:12,201 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:55:12,201 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:12,202 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:55:12,202 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,202 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:12,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:12,202 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:55:12,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:12,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:12,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:12,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:12,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:12,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:55:12,204 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:55:12,204 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:12,204 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:12,204 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,204 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:12,205 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,205 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:12,205 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:12,205 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,206 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:12,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,207 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,207 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,207 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,207 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,208 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,208 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:12,208 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:12,208 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:12,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:55:12,208 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,208 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:12,208 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:12,208 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:12,208 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:12,208 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:12,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:12,308 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:12,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:12,313 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:12,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:55:12,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,314 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:12,315 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:12,315 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:55:12,315 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:55:12,315 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,315 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,316 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:12,316 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:12,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:12,316 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:12,316 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:12,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:12,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,317 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,317 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:55:12,317 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:12,317 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:55:12,317 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:12,317 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:55:12,317 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:55:12,317 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:12,317 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:12,317 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. started... 2023-10-30 06:55:12,317 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c9cc40ce683e8c632aae150d7ae235fb 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:55:12,728 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101147236a1e0af4f528fd3c3e167e2c395 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101147236a1e0af4f528fd3c3e167e2c395 2023-10-30 06:55:13,133 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/ea4f77d04c8e4390b021d18aec1582b3 2023-10-30 06:55:13,140 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/ea4f77d04c8e4390b021d18aec1582b3 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ea4f77d04c8e4390b021d18aec1582b3 2023-10-30 06:55:13,145 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ea4f77d04c8e4390b021d18aec1582b3, entries=1, sequenceid=29, filesize=4.9 K 2023-10-30 06:55:13,146 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c9cc40ce683e8c632aae150d7ae235fb in 829ms, sequenceid=29, compaction requested=true 2023-10-30 06:55:13,146 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:13,146 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:13,146 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:55:13,146 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:55:13,146 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,146 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:55:13,146 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:55:13,147 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,147 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:13,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:13,147 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,147 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:13,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:13,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:13,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:13,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:55:13,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6276bea6[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:13,149 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:55:13,149 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,149 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,149 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:55:13,149 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:55:13,149 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:13,149 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,149 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:13,150 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:55:13,150 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:13,150 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,150 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:55:13,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:13,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:13,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:13,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:13,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:13,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:13,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:55:13,152 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:55:13,152 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:13,152 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:13,152 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,152 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:13,153 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,153 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:13,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:13,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,153 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:13,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:13,153 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:13,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,154 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:13,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,156 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:13,156 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:13,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:13,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:55:13,156 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,156 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:13,156 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:13,156 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:13,156 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:13,156 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,156 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,156 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,156 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,156 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,156 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:13,156 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:13,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:13,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:13,257 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:13,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:13,261 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:13,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:55:13,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,263 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:13,263 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:13,263 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:55:13,263 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:55:13,263 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,263 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,264 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,264 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:13,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:13,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:13,264 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:13,265 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:13,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:13,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,265 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,265 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:55:13,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:13,265 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:55:13,265 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:13,265 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:55:13,266 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:55:13,266 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:13,266 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:13,266 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. started... 2023-10-30 06:55:13,266 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c9cc40ce683e8c632aae150d7ae235fb 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:55:13,676 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033691d809a56d45359ba63eda338b90ef to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601033691d809a56d45359ba63eda338b90ef 2023-10-30 06:55:14,083 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/ad0754a93d334a7586ae608ef0f8db36 2023-10-30 06:55:14,093 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/ad0754a93d334a7586ae608ef0f8db36 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ad0754a93d334a7586ae608ef0f8db36 2023-10-30 06:55:14,099 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ad0754a93d334a7586ae608ef0f8db36, entries=1, sequenceid=33, filesize=4.9 K 2023-10-30 06:55:14,100 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c9cc40ce683e8c632aae150d7ae235fb in 834ms, sequenceid=33, compaction requested=true 2023-10-30 06:55:14,100 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:14,100 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:14,101 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:55:14,101 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:55:14,101 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,101 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:55:14,101 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:55:14,102 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,102 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:14,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:14,103 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,103 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:14,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:14,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:14,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:14,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:55:14,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b0cece9[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:14,105 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:55:14,106 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,106 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,107 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:55:14,107 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:55:14,107 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:14,107 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,107 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:14,109 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:55:14,109 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,109 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:14,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:14,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:14,109 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:55:14,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:14,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:14,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:14,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:14,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:55:14,113 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:55:14,113 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:14,113 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:14,113 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,113 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:14,121 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,121 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:14,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:14,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,121 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:14,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:14,122 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:14,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:14,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:14,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,125 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:14,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,129 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,129 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:14,130 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:14,130 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,130 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:14,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:55:14,130 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:14,130 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:14,130 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:14,130 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,131 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:14,131 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:14,131 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:14,131 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,132 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,231 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:14,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:14,242 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:14,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:55:14,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,245 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:14,245 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:14,245 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:55:14,245 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:55:14,246 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,246 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,247 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:14,247 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:14,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:14,248 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,248 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:14,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:14,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,248 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,249 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:55:14,249 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,249 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:55:14,249 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:14,249 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:55:14,249 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:55:14,249 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:14,249 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:14,249 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. started... 2023-10-30 06:55:14,249 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c9cc40ce683e8c632aae150d7ae235fb 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:55:14,263 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a61d723275e54b6bbb971fb9c69b9688 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907a61d723275e54b6bbb971fb9c69b9688 2023-10-30 06:55:14,671 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/19c1e5d153524633a361ba5e2ea94a2d 2023-10-30 06:55:14,682 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/19c1e5d153524633a361ba5e2ea94a2d as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/19c1e5d153524633a361ba5e2ea94a2d 2023-10-30 06:55:14,688 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/19c1e5d153524633a361ba5e2ea94a2d, entries=1, sequenceid=37, filesize=4.9 K 2023-10-30 06:55:14,689 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c9cc40ce683e8c632aae150d7ae235fb in 440ms, sequenceid=37, compaction requested=true 2023-10-30 06:55:14,689 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:14,689 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:14,689 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:55:14,689 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:55:14,689 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,689 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:55:14,689 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:55:14,691 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,691 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:14,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:14,691 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,691 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:14,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:14,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:14,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:14,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:55:14,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16881bb6[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:14,694 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:55:14,694 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,695 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,696 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:55:14,696 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:55:14,696 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:14,696 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,696 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:14,697 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:55:14,697 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,697 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:14,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:14,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:14,697 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:55:14,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:14,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:14,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:14,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:14,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:55:14,702 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:55:14,702 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:14,702 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:14,702 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,702 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:14,708 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,708 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:14,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:14,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,709 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:14,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:14,709 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:14,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:14,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:14,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,711 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:14,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,717 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,717 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:14,717 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,717 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,717 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:14,717 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:14,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:14,717 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:14,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:14,717 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,718 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:14,717 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:14,718 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:14,718 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,718 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,718 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:14,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:14,818 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:14,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:14,831 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:14,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 06:55:14,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,834 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:14,834 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:14,834 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 06:55:14,834 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 06:55:14,835 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,835 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,836 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:14,836 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:14,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:14,837 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:14,837 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:14,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:14,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,839 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,839 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 06:55:14,840 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:14,840 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 06:55:14,840 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:14,840 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 06:55:14,840 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 06:55:14,840 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:14,840 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:14,840 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. started... 2023-10-30 06:55:14,840 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c9cc40ce683e8c632aae150d7ae235fb 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 06:55:15,264 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511203af1be39537646bcb5264f46653c96d8 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511203af1be39537646bcb5264f46653c96d8 2023-10-30 06:55:15,672 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/008dc08bdee84dce8ff2051b8d45f452 2023-10-30 06:55:15,683 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/008dc08bdee84dce8ff2051b8d45f452 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/008dc08bdee84dce8ff2051b8d45f452 2023-10-30 06:55:15,689 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/008dc08bdee84dce8ff2051b8d45f452, entries=1, sequenceid=41, filesize=4.9 K 2023-10-30 06:55:15,690 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c9cc40ce683e8c632aae150d7ae235fb in 850ms, sequenceid=41, compaction requested=true 2023-10-30 06:55:15,690 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:15,690 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:15,690 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 06:55:15,690 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 06:55:15,690 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,690 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 06:55:15,690 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 06:55:15,692 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,692 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:15,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:15,692 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,692 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:15,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:15,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:15,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:15,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 06:55:15,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22254566[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:15,695 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 06:55:15,695 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,695 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,696 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 06:55:15,696 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 06:55:15,696 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:15,696 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,696 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:15,697 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,697 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 06:55:15,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:15,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:15,697 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:15,697 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 06:55:15,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:15,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:15,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:15,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:15,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 06:55:15,701 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 06:55:15,701 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:15,701 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:15,701 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,701 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:15,702 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,702 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:15,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:15,702 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:15,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:15,703 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:15,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:15,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:15,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,705 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:15,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,707 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,707 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,707 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,707 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:15,707 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:15,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 06:55:15,707 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:15,707 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 06:55:15,708 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:15,707 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:15,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:15,707 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:15,708 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,708 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:15,708 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:15,708 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:15,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:15,808 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:15,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:15,811 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-10-30 06:55:15,813 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 06:55:15,814 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 06:55:15,815 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:55:15,815 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649515815 2023-10-30 06:55:15,817 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 06:55:15,818 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-10-30 06:55:15,819 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:55:15,820 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x705fdefc to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:55:15,825 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c4f1da3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:55:15,825 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:55:16,255 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034b8c098147be4945b37e889cd00d9c6e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601034b8c098147be4945b37e889cd00d9c6e 2023-10-30 06:55:16,256 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:55:16,275 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:55:16,277 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:55:16,283 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:55:16,284 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:55:16,292 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7ad8c76fe2af4fdabaffaf1c7bf08d1e first=Optional[r5] last=Optional[r6] 2023-10-30 06:55:16,293 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7ad8c76fe2af4fdabaffaf1c7bf08d1e}] 2023-10-30 06:55:16,299 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7ad8c76fe2af4fdabaffaf1c7bf08d1e for inclusion in c9cc40ce683e8c632aae150d7ae235fb/family1 2023-10-30 06:55:16,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-10-30 06:55:16,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:55:16,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:16,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7ad8c76fe2af4fdabaffaf1c7bf08d1e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__184of1o46k1gqpcnpf4rep3d0kcersb6106s62fj23u54is5qjqikmtarid1pn04/family1/7ad8c76fe2af4fdabaffaf1c7bf08d1e 2023-10-30 06:55:16,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__184of1o46k1gqpcnpf4rep3d0kcersb6106s62fj23u54is5qjqikmtarid1pn04/family1/7ad8c76fe2af4fdabaffaf1c7bf08d1e as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/e5ef3150c89940babfcb2ef3621b9612_SeqId_44_ 2023-10-30 06:55:16,305 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__184of1o46k1gqpcnpf4rep3d0kcersb6106s62fj23u54is5qjqikmtarid1pn04/family1/7ad8c76fe2af4fdabaffaf1c7bf08d1e into c9cc40ce683e8c632aae150d7ae235fb/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/e5ef3150c89940babfcb2ef3621b9612_SeqId_44_ - updating store file list. 2023-10-30 06:55:16,308 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/e5ef3150c89940babfcb2ef3621b9612_SeqId_44_ into c9cc40ce683e8c632aae150d7ae235fb/family1 2023-10-30 06:55:16,308 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__184of1o46k1gqpcnpf4rep3d0kcersb6106s62fj23u54is5qjqikmtarid1pn04/family1/7ad8c76fe2af4fdabaffaf1c7bf08d1e into c9cc40ce683e8c632aae150d7ae235fb/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/e5ef3150c89940babfcb2ef3621b9612_SeqId_44_) 2023-10-30 06:55:16,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__184of1o46k1gqpcnpf4rep3d0kcersb6106s62fj23u54is5qjqikmtarid1pn04/family1/7ad8c76fe2af4fdabaffaf1c7bf08d1e 2023-10-30 06:55:16,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 06:55:16,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 06:55:16,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(1912): c9cc40ce683e8c632aae150d7ae235fb/family1 is initiating minor compaction 2023-10-30 06:55:16,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@8892e99; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:55:16,312 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c9cc40ce683e8c632aae150d7ae235fb/family1 in testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:16,312 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/5d964a0342294c1c899d426a2b4647a4, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ebd7b3b26f374887b7f95750cc1bdf98, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/f252bf887b0d4ea3991cfd5861028d15, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/f2ebcaa77cb34aa4926cc74a81df2f9d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/4eeed5008504458cb945760393e1f1e1, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ea4f77d04c8e4390b021d18aec1582b3, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ad0754a93d334a7586ae608ef0f8db36, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/19c1e5d153524633a361ba5e2ea94a2d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/008dc08bdee84dce8ff2051b8d45f452, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/e5ef3150c89940babfcb2ef3621b9612_SeqId_44_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp, totalSize=49.7 K 2023-10-30 06:55:16,312 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 5d964a0342294c1c899d426a2b4647a4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 06:55:16,312 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting ebd7b3b26f374887b7f95750cc1bdf98, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 06:55:16,312 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting f252bf887b0d4ea3991cfd5861028d15, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 06:55:16,312 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting f2ebcaa77cb34aa4926cc74a81df2f9d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 06:55:16,312 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 4eeed5008504458cb945760393e1f1e1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 06:55:16,312 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting ea4f77d04c8e4390b021d18aec1582b3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 06:55:16,312 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting ad0754a93d334a7586ae608ef0f8db36, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 06:55:16,312 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 19c1e5d153524633a361ba5e2ea94a2d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 06:55:16,312 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 008dc08bdee84dce8ff2051b8d45f452, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 06:55:16,312 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting e5ef3150c89940babfcb2ef3621b9612_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 06:55:16,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:55:16,314 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:16,315 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101147236a1e0af4f528fd3c3e167e2c395 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101147236a1e0af4f528fd3c3e167e2c395 2023-10-30 06:55:16,316 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601033691d809a56d45359ba63eda338b90ef to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601033691d809a56d45359ba63eda338b90ef 2023-10-30 06:55:16,316 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-10-30 06:55:16,316 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-10-30 06:55:16,317 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:55:16,317 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:55:16,331 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): c9cc40ce683e8c632aae150d7ae235fb#family1#compaction#165 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-30 06:55:16,757 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/d744f0c7dee141f78d222b7f79f4ea34 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/d744f0c7dee141f78d222b7f79f4ea34 2023-10-30 06:55:16,760 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319875b1bf17a94ecbac05c3acc4455b2e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512319875b1bf17a94ecbac05c3acc4455b2e 2023-10-30 06:55:16,760 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:55:16,761 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c9cc40ce683e8c632aae150d7ae235fb/family1 of c9cc40ce683e8c632aae150d7ae235fb into d744f0c7dee141f78d222b7f79f4ea34(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:55:16,761 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:16,761 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698648916312; duration=0sec 2023-10-30 06:55:16,761 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:55:16,781 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8e81774ea1a1490e9ddbfc88330abddd first=Optional[r1] last=Optional[r4] 2023-10-30 06:55:16,781 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8e81774ea1a1490e9ddbfc88330abddd}] 2023-10-30 06:55:16,783 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8e81774ea1a1490e9ddbfc88330abddd for inclusion in c9cc40ce683e8c632aae150d7ae235fb/family1 2023-10-30 06:55:16,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-10-30 06:55:16,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:55:16,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:16,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8e81774ea1a1490e9ddbfc88330abddd to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__99k7ock6eboggne1ecsekpls24h7io7sh7bvc9l69n1qcoh01342aruhk27ie4m5/family1/8e81774ea1a1490e9ddbfc88330abddd 2023-10-30 06:55:16,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__99k7ock6eboggne1ecsekpls24h7io7sh7bvc9l69n1qcoh01342aruhk27ie4m5/family1/8e81774ea1a1490e9ddbfc88330abddd as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/7ac763da2c114d409025fb700ee5ff21_SeqId_47_ 2023-10-30 06:55:16,790 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__99k7ock6eboggne1ecsekpls24h7io7sh7bvc9l69n1qcoh01342aruhk27ie4m5/family1/8e81774ea1a1490e9ddbfc88330abddd into c9cc40ce683e8c632aae150d7ae235fb/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/7ac763da2c114d409025fb700ee5ff21_SeqId_47_ - updating store file list. 2023-10-30 06:55:16,793 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/7ac763da2c114d409025fb700ee5ff21_SeqId_47_ into c9cc40ce683e8c632aae150d7ae235fb/family1 2023-10-30 06:55:16,793 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__99k7ock6eboggne1ecsekpls24h7io7sh7bvc9l69n1qcoh01342aruhk27ie4m5/family1/8e81774ea1a1490e9ddbfc88330abddd into c9cc40ce683e8c632aae150d7ae235fb/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/7ac763da2c114d409025fb700ee5ff21_SeqId_47_) 2023-10-30 06:55:16,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__99k7ock6eboggne1ecsekpls24h7io7sh7bvc9l69n1qcoh01342aruhk27ie4m5/family1/8e81774ea1a1490e9ddbfc88330abddd 2023-10-30 06:55:16,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 06:55:16,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 06:55:16,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(1912): c9cc40ce683e8c632aae150d7ae235fb/family1 is initiating minor compaction (all files) 2023-10-30 06:55:16,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5b30c20; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:55:16,795 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c9cc40ce683e8c632aae150d7ae235fb/family1 in testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:16,795 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/5229578e3f144901a68f0addb4494054, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/d744f0c7dee141f78d222b7f79f4ea34, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/7ac763da2c114d409025fb700ee5ff21_SeqId_47_] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp, totalSize=178.1 K 2023-10-30 06:55:16,796 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 5229578e3f144901a68f0addb4494054, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878849956 2023-10-30 06:55:16,796 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting d744f0c7dee141f78d222b7f79f4ea34, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621249956 2023-10-30 06:55:16,797 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] compactions.Compactor(207): Compacting 7ac763da2c114d409025fb700ee5ff21_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965249956 2023-10-30 06:55:16,797 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:55:16,798 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:16,799 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120184c68388c3314c4596d94a702e8472be to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120184c68388c3314c4596d94a702e8472be 2023-10-30 06:55:16,800 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512050aa6490bf275425f8246f28600da672a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512050aa6490bf275425f8246f28600da672a 2023-10-30 06:55:16,803 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228fe1a39ee4ea7432bbd1a34b47f0bde3f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228fe1a39ee4ea7432bbd1a34b47f0bde3f 2023-10-30 06:55:16,805 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231f58babb433fc4ed68e5f0a9b25d0c3de to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231f58babb433fc4ed68e5f0a9b25d0c3de 2023-10-30 06:55:16,805 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-10-30 06:55:16,805 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-10-30 06:55:16,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:55:16,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:55:16,812 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] throttle.PressureAwareThroughputController(145): c9cc40ce683e8c632aae150d7ae235fb#family1#compaction#166 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-30 06:55:16,814 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/5d964a0342294c1c899d426a2b4647a4, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ebd7b3b26f374887b7f95750cc1bdf98, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/f252bf887b0d4ea3991cfd5861028d15, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/f2ebcaa77cb34aa4926cc74a81df2f9d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/4eeed5008504458cb945760393e1f1e1, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ea4f77d04c8e4390b021d18aec1582b3, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ad0754a93d334a7586ae608ef0f8db36, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/19c1e5d153524633a361ba5e2ea94a2d, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/008dc08bdee84dce8ff2051b8d45f452, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/e5ef3150c89940babfcb2ef3621b9612_SeqId_44_] to archive 2023-10-30 06:55:16,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:16,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/5d964a0342294c1c899d426a2b4647a4 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/5d964a0342294c1c899d426a2b4647a4 2023-10-30 06:55:16,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ebd7b3b26f374887b7f95750cc1bdf98 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ebd7b3b26f374887b7f95750cc1bdf98 2023-10-30 06:55:16,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/f252bf887b0d4ea3991cfd5861028d15 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/f252bf887b0d4ea3991cfd5861028d15 2023-10-30 06:55:16,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/f2ebcaa77cb34aa4926cc74a81df2f9d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/f2ebcaa77cb34aa4926cc74a81df2f9d 2023-10-30 06:55:16,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/4eeed5008504458cb945760393e1f1e1 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/4eeed5008504458cb945760393e1f1e1 2023-10-30 06:55:16,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ea4f77d04c8e4390b021d18aec1582b3 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ea4f77d04c8e4390b021d18aec1582b3 2023-10-30 06:55:16,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ad0754a93d334a7586ae608ef0f8db36 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/ad0754a93d334a7586ae608ef0f8db36 2023-10-30 06:55:16,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/19c1e5d153524633a361ba5e2ea94a2d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/19c1e5d153524633a361ba5e2ea94a2d 2023-10-30 06:55:16,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/008dc08bdee84dce8ff2051b8d45f452 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/008dc08bdee84dce8ff2051b8d45f452 2023-10-30 06:55:16,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/e5ef3150c89940babfcb2ef3621b9612_SeqId_44_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/e5ef3150c89940babfcb2ef3621b9612_SeqId_44_ 2023-10-30 06:55:17,250 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f31edaac746941b2ad600f82b1c45dad to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130f31edaac746941b2ad600f82b1c45dad 2023-10-30 06:55:17,251 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:55:17,277 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/71e43272501a4ce6b6effe521adc00d1 first=Optional[r00] last=Optional[r8] 2023-10-30 06:55:17,278 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/71e43272501a4ce6b6effe521adc00d1}] 2023-10-30 06:55:17,280 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/71e43272501a4ce6b6effe521adc00d1 for inclusion in c9cc40ce683e8c632aae150d7ae235fb/family1 2023-10-30 06:55:17,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-10-30 06:55:17,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 06:55:17,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:17,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/71e43272501a4ce6b6effe521adc00d1 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__apb6lkodslgm5catdl254kobcpj368c749hb3i59545oae0jhr42mjr5lpsfugji/family1/71e43272501a4ce6b6effe521adc00d1 2023-10-30 06:55:17,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__apb6lkodslgm5catdl254kobcpj368c749hb3i59545oae0jhr42mjr5lpsfugji/family1/71e43272501a4ce6b6effe521adc00d1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/21bc25434b8c4818b7256b4e1c58b04c_SeqId_49_ 2023-10-30 06:55:17,286 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__apb6lkodslgm5catdl254kobcpj368c749hb3i59545oae0jhr42mjr5lpsfugji/family1/71e43272501a4ce6b6effe521adc00d1 into c9cc40ce683e8c632aae150d7ae235fb/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/21bc25434b8c4818b7256b4e1c58b04c_SeqId_49_ - updating store file list. 2023-10-30 06:55:17,289 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/21bc25434b8c4818b7256b4e1c58b04c_SeqId_49_ into c9cc40ce683e8c632aae150d7ae235fb/family1 2023-10-30 06:55:17,289 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__apb6lkodslgm5catdl254kobcpj368c749hb3i59545oae0jhr42mjr5lpsfugji/family1/71e43272501a4ce6b6effe521adc00d1 into c9cc40ce683e8c632aae150d7ae235fb/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/21bc25434b8c4818b7256b4e1c58b04c_SeqId_49_) 2023-10-30 06:55:17,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMinorCompactionWithMonthlyPolicy__apb6lkodslgm5catdl254kobcpj368c749hb3i59545oae0jhr42mjr5lpsfugji/family1/71e43272501a4ce6b6effe521adc00d1 2023-10-30 06:55:17,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:55:17,292 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:17,294 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511203af1be39537646bcb5264f46653c96d8 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511203af1be39537646bcb5264f46653c96d8 2023-10-30 06:55:17,295 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511287d11029c8546430c84665bfe1c7c180d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511287d11029c8546430c84665bfe1c7c180d 2023-10-30 06:55:17,296 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113050de856c5cca486b870057ea3f1cf965 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113050de856c5cca486b870057ea3f1cf965 2023-10-30 06:55:17,296 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-10-30 06:55:17,296 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 06:55:17,297 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:55:17,297 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:55:17,297 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 06:55:17,297 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 06:55:17,297 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:55:17,300 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 06:55:17,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.4880 sec 2023-10-30 06:55:17,481 INFO [Listener at localhost/40811] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=262 (was 258) - Thread LEAK? -, OpenFileDescriptor=659 (was 646) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=146 (was 163), ProcessCount=167 (was 167), AvailableMemoryMB=3206 (was 2232) - AvailableMemoryMB LEAK? - 2023-10-30 06:55:17,493 INFO [Listener at localhost/40811] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=262, OpenFileDescriptor=659, MaxFileDescriptor=60000, SystemLoadAverage=146, ProcessCount=167, AvailableMemoryMB=3205 2023-10-30 06:55:17,509 DEBUG [Listener at localhost/40811] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-10-30 06:55:17,551 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10XM\xEF\x83\xA2#\x8AZ\x12\x1D\x88\xB2\xF1\xFDc\xD4"\x10\xFD+Th\xFD\x16\x85\xA3\xD0\x09\xE2\xD6\xB9&\x81\xDE*\x10B\x853\x0C\x98b\x16\xFE53\x90y\xF2&\xDA\x9C2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 06:55:17,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-10-30 06:55:17,554 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 06:55:17,554 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-10-30 06:55:17,554 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 06:55:17,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 06:55:17,556 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1 2023-10-30 06:55:17,556 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb 2023-10-30 06:55:17,556 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210 2023-10-30 06:55:17,557 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1 empty. 2023-10-30 06:55:17,557 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb empty. 2023-10-30 06:55:17,557 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210 empty. 2023-10-30 06:55:17,557 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1 2023-10-30 06:55:17,557 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb 2023-10-30 06:55:17,557 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210 2023-10-30 06:55:17,557 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-10-30 06:55:17,640 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/.tmp/family1/be6ee3109ac440ddad39ed795d361257 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/be6ee3109ac440ddad39ed795d361257 2023-10-30 06:55:17,648 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c9cc40ce683e8c632aae150d7ae235fb/family1 of c9cc40ce683e8c632aae150d7ae235fb into be6ee3109ac440ddad39ed795d361257(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:55:17,648 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:17,648 INFO [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698648916795; duration=0sec 2023-10-30 06:55:17,648 DEBUG [RS:0;jenkins-hbase20:40611-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 06:55:17,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 06:55:17,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/5229578e3f144901a68f0addb4494054, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/d744f0c7dee141f78d222b7f79f4ea34, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/7ac763da2c114d409025fb700ee5ff21_SeqId_47_] to archive 2023-10-30 06:55:17,712 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:17,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/5229578e3f144901a68f0addb4494054 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/5229578e3f144901a68f0addb4494054 2023-10-30 06:55:17,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/d744f0c7dee141f78d222b7f79f4ea34 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/d744f0c7dee141f78d222b7f79f4ea34 2023-10-30 06:55:17,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/7ac763da2c114d409025fb700ee5ff21_SeqId_47_ to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/family1/7ac763da2c114d409025fb700ee5ff21_SeqId_47_ 2023-10-30 06:55:17,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 06:55:17,966 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-10-30 06:55:17,969 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 92d81501e99ecb332aa05a4d435c4bd1, NAME => 'testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10XM\xEF\x83\xA2#\x8AZ\x12\x1D\x88\xB2\xF1\xFDc\xD4"\x10\xFD+Th\xFD\x16\x85\xA3\xD0\x09\xE2\xD6\xB9&\x81\xDE*\x10B\x853\x0C\x98b\x16\xFE53\x90y\xF2&\xDA\x9C2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:55:17,971 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 35f25523e5b1e828eda38c732550fbcb, NAME => 'testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10XM\xEF\x83\xA2#\x8AZ\x12\x1D\x88\xB2\xF1\xFDc\xD4"\x10\xFD+Th\xFD\x16\x85\xA3\xD0\x09\xE2\xD6\xB9&\x81\xDE*\x10B\x853\x0C\x98b\x16\xFE53\x90y\xF2&\xDA\x9C2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:55:17,971 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 0de074978d93be6422cc45784f698210, NAME => 'testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10XM\xEF\x83\xA2#\x8AZ\x12\x1D\x88\xB2\xF1\xFDc\xD4"\x10\xFD+Th\xFD\x16\x85\xA3\xD0\x09\xE2\xD6\xB9&\x81\xDE*\x10B\x853\x0C\x98b\x16\xFE53\x90y\xF2&\xDA\x9C2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/.tmp 2023-10-30 06:55:17,984 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:55:17,984 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 92d81501e99ecb332aa05a4d435c4bd1, disabling compactions & flushes 2023-10-30 06:55:17,984 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:17,984 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:17,984 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. after waiting 0 ms 2023-10-30 06:55:17,984 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:17,984 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:17,984 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 92d81501e99ecb332aa05a4d435c4bd1: 2023-10-30 06:55:18,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 06:55:18,386 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:55:18,386 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 35f25523e5b1e828eda38c732550fbcb, disabling compactions & flushes 2023-10-30 06:55:18,386 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:18,386 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:18,386 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:55:18,386 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. after waiting 0 ms 2023-10-30 06:55:18,387 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:18,387 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:18,387 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 35f25523e5b1e828eda38c732550fbcb: 2023-10-30 06:55:18,387 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 0de074978d93be6422cc45784f698210, disabling compactions & flushes 2023-10-30 06:55:18,387 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:18,388 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:18,388 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. after waiting 0 ms 2023-10-30 06:55:18,388 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:18,388 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:18,388 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 0de074978d93be6422cc45784f698210: 2023-10-30 06:55:18,393 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 06:55:18,395 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698648918395"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648918395"}]},"ts":"1698648918395"} 2023-10-30 06:55:18,395 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698648918395"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648918395"}]},"ts":"1698648918395"} 2023-10-30 06:55:18,395 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698648918395"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698648918395"}]},"ts":"1698648918395"} 2023-10-30 06:55:18,397 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 06:55:18,398 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 06:55:18,398 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648918398"}]},"ts":"1698648918398"} 2023-10-30 06:55:18,400 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-10-30 06:55:18,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=92d81501e99ecb332aa05a4d435c4bd1, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=35f25523e5b1e828eda38c732550fbcb, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0de074978d93be6422cc45784f698210, ASSIGN}] 2023-10-30 06:55:18,405 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0de074978d93be6422cc45784f698210, ASSIGN 2023-10-30 06:55:18,405 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=35f25523e5b1e828eda38c732550fbcb, ASSIGN 2023-10-30 06:55:18,405 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=92d81501e99ecb332aa05a4d435c4bd1, ASSIGN 2023-10-30 06:55:18,406 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0de074978d93be6422cc45784f698210, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:55:18,406 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=35f25523e5b1e828eda38c732550fbcb, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:55:18,406 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=92d81501e99ecb332aa05a4d435c4bd1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40611,1698648765457; forceNewPlan=false, retain=false 2023-10-30 06:55:18,559 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=0de074978d93be6422cc45784f698210, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:18,560 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=35f25523e5b1e828eda38c732550fbcb, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:18,560 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698648918559"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648918559"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648918559"}]},"ts":"1698648918559"} 2023-10-30 06:55:18,560 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698648918559"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648918559"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648918559"}]},"ts":"1698648918559"} 2023-10-30 06:55:18,559 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=92d81501e99ecb332aa05a4d435c4bd1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:18,560 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698648918559"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698648918559"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698648918559"}]},"ts":"1698648918559"} 2023-10-30 06:55:18,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure 0de074978d93be6422cc45784f698210, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:55:18,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 35f25523e5b1e828eda38c732550fbcb, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:55:18,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure 92d81501e99ecb332aa05a4d435c4bd1, server=jenkins-hbase20.apache.org,40611,1698648765457}] 2023-10-30 06:55:18,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 06:55:18,713 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:18,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:18,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0de074978d93be6422cc45784f698210, NAME => 'testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 06:55:18,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 0de074978d93be6422cc45784f698210 2023-10-30 06:55:18,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:55:18,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0de074978d93be6422cc45784f698210 2023-10-30 06:55:18,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0de074978d93be6422cc45784f698210 2023-10-30 06:55:18,734 INFO [StoreOpener-0de074978d93be6422cc45784f698210-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0de074978d93be6422cc45784f698210 2023-10-30 06:55:18,736 DEBUG [StoreOpener-0de074978d93be6422cc45784f698210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1 2023-10-30 06:55:18,736 DEBUG [StoreOpener-0de074978d93be6422cc45784f698210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1 2023-10-30 06:55:18,736 INFO [StoreOpener-0de074978d93be6422cc45784f698210-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0de074978d93be6422cc45784f698210 columnFamilyName family1 2023-10-30 06:55:18,737 INFO [StoreOpener-0de074978d93be6422cc45784f698210-1] regionserver.HStore(310): Store=0de074978d93be6422cc45784f698210/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:55:18,737 INFO [StoreOpener-0de074978d93be6422cc45784f698210-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0de074978d93be6422cc45784f698210 2023-10-30 06:55:18,738 DEBUG [StoreOpener-0de074978d93be6422cc45784f698210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2 2023-10-30 06:55:18,739 DEBUG [StoreOpener-0de074978d93be6422cc45784f698210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2 2023-10-30 06:55:18,739 INFO [StoreOpener-0de074978d93be6422cc45784f698210-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0de074978d93be6422cc45784f698210 columnFamilyName family2 2023-10-30 06:55:18,740 INFO [StoreOpener-0de074978d93be6422cc45784f698210-1] regionserver.HStore(310): Store=0de074978d93be6422cc45784f698210/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:55:18,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210 2023-10-30 06:55:18,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210 2023-10-30 06:55:18,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:55:18,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0de074978d93be6422cc45784f698210 2023-10-30 06:55:18,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:55:18,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0de074978d93be6422cc45784f698210; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61911464, jitterRate=-0.07744729518890381}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:55:18,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0de074978d93be6422cc45784f698210: 2023-10-30 06:55:18,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210., pid=120, masterSystemTime=1698648918713 2023-10-30 06:55:18,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:18,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:18,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:18,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 92d81501e99ecb332aa05a4d435c4bd1, NAME => 'testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 06:55:18,746 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=0de074978d93be6422cc45784f698210, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:18,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 92d81501e99ecb332aa05a4d435c4bd1 2023-10-30 06:55:18,746 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698648918746"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648918746"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648918746"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648918746"}]},"ts":"1698648918746"} 2023-10-30 06:55:18,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:55:18,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 92d81501e99ecb332aa05a4d435c4bd1 2023-10-30 06:55:18,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 92d81501e99ecb332aa05a4d435c4bd1 2023-10-30 06:55:18,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=119 2023-10-30 06:55:18,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure 0de074978d93be6422cc45784f698210, server=jenkins-hbase20.apache.org,40611,1698648765457 in 186 msec 2023-10-30 06:55:18,750 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0de074978d93be6422cc45784f698210, ASSIGN in 347 msec 2023-10-30 06:55:18,766 INFO [StoreOpener-92d81501e99ecb332aa05a4d435c4bd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 92d81501e99ecb332aa05a4d435c4bd1 2023-10-30 06:55:18,767 DEBUG [StoreOpener-92d81501e99ecb332aa05a4d435c4bd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1 2023-10-30 06:55:18,767 DEBUG [StoreOpener-92d81501e99ecb332aa05a4d435c4bd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1 2023-10-30 06:55:18,767 INFO [StoreOpener-92d81501e99ecb332aa05a4d435c4bd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92d81501e99ecb332aa05a4d435c4bd1 columnFamilyName family1 2023-10-30 06:55:18,768 INFO [StoreOpener-92d81501e99ecb332aa05a4d435c4bd1-1] regionserver.HStore(310): Store=92d81501e99ecb332aa05a4d435c4bd1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:55:18,768 INFO [StoreOpener-92d81501e99ecb332aa05a4d435c4bd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 92d81501e99ecb332aa05a4d435c4bd1 2023-10-30 06:55:18,769 DEBUG [StoreOpener-92d81501e99ecb332aa05a4d435c4bd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2 2023-10-30 06:55:18,769 DEBUG [StoreOpener-92d81501e99ecb332aa05a4d435c4bd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2 2023-10-30 06:55:18,770 INFO [StoreOpener-92d81501e99ecb332aa05a4d435c4bd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92d81501e99ecb332aa05a4d435c4bd1 columnFamilyName family2 2023-10-30 06:55:18,770 INFO [StoreOpener-92d81501e99ecb332aa05a4d435c4bd1-1] regionserver.HStore(310): Store=92d81501e99ecb332aa05a4d435c4bd1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:55:18,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1 2023-10-30 06:55:18,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1 2023-10-30 06:55:18,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:55:18,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 92d81501e99ecb332aa05a4d435c4bd1 2023-10-30 06:55:18,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:55:18,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 92d81501e99ecb332aa05a4d435c4bd1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64912391, jitterRate=-0.03272999823093414}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:55:18,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 92d81501e99ecb332aa05a4d435c4bd1: 2023-10-30 06:55:18,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1., pid=122, masterSystemTime=1698648918713 2023-10-30 06:55:18,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:18,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:18,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:18,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 35f25523e5b1e828eda38c732550fbcb, NAME => 'testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 06:55:18,777 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=92d81501e99ecb332aa05a4d435c4bd1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:18,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 35f25523e5b1e828eda38c732550fbcb 2023-10-30 06:55:18,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 06:55:18,778 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698648918777"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648918777"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648918777"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648918777"}]},"ts":"1698648918777"} 2023-10-30 06:55:18,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 35f25523e5b1e828eda38c732550fbcb 2023-10-30 06:55:18,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 35f25523e5b1e828eda38c732550fbcb 2023-10-30 06:55:18,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=117 2023-10-30 06:55:18,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure 92d81501e99ecb332aa05a4d435c4bd1, server=jenkins-hbase20.apache.org,40611,1698648765457 in 216 msec 2023-10-30 06:55:18,781 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=92d81501e99ecb332aa05a4d435c4bd1, ASSIGN in 378 msec 2023-10-30 06:55:18,798 INFO [StoreOpener-35f25523e5b1e828eda38c732550fbcb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 35f25523e5b1e828eda38c732550fbcb 2023-10-30 06:55:18,799 DEBUG [StoreOpener-35f25523e5b1e828eda38c732550fbcb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1 2023-10-30 06:55:18,800 DEBUG [StoreOpener-35f25523e5b1e828eda38c732550fbcb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1 2023-10-30 06:55:18,800 INFO [StoreOpener-35f25523e5b1e828eda38c732550fbcb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35f25523e5b1e828eda38c732550fbcb columnFamilyName family1 2023-10-30 06:55:18,800 INFO [StoreOpener-35f25523e5b1e828eda38c732550fbcb-1] regionserver.HStore(310): Store=35f25523e5b1e828eda38c732550fbcb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:55:18,801 INFO [StoreOpener-35f25523e5b1e828eda38c732550fbcb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 35f25523e5b1e828eda38c732550fbcb 2023-10-30 06:55:18,802 DEBUG [StoreOpener-35f25523e5b1e828eda38c732550fbcb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2 2023-10-30 06:55:18,802 DEBUG [StoreOpener-35f25523e5b1e828eda38c732550fbcb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2 2023-10-30 06:55:18,802 INFO [StoreOpener-35f25523e5b1e828eda38c732550fbcb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35f25523e5b1e828eda38c732550fbcb columnFamilyName family2 2023-10-30 06:55:18,802 INFO [StoreOpener-35f25523e5b1e828eda38c732550fbcb-1] regionserver.HStore(310): Store=35f25523e5b1e828eda38c732550fbcb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 06:55:18,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb 2023-10-30 06:55:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb 2023-10-30 06:55:18,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 06:55:18,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 35f25523e5b1e828eda38c732550fbcb 2023-10-30 06:55:18,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 06:55:18,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 35f25523e5b1e828eda38c732550fbcb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60493863, jitterRate=-0.09857119619846344}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 06:55:18,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 35f25523e5b1e828eda38c732550fbcb: 2023-10-30 06:55:18,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb., pid=121, masterSystemTime=1698648918713 2023-10-30 06:55:18,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:18,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:18,810 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=35f25523e5b1e828eda38c732550fbcb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:18,810 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698648918810"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698648918810"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698648918810"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698648918810"}]},"ts":"1698648918810"} 2023-10-30 06:55:18,812 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=118 2023-10-30 06:55:18,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 35f25523e5b1e828eda38c732550fbcb, server=jenkins-hbase20.apache.org,40611,1698648765457 in 249 msec 2023-10-30 06:55:18,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-30 06:55:18,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=35f25523e5b1e828eda38c732550fbcb, ASSIGN in 411 msec 2023-10-30 06:55:18,814 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 06:55:18,814 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698648918814"}]},"ts":"1698648918814"} 2023-10-30 06:55:18,815 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-10-30 06:55:18,818 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 06:55:18,819 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2660 sec 2023-10-30 06:55:19,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 06:55:19,665 INFO [Listener at localhost/40811] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-10-30 06:55:19,675 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:55:19,676 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:55:19,677 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:55:19,679 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:19,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 06:55:19,681 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 06:55:19,681 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:19,681 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 06:55:19,681 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 06:55:19,681 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:19,682 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:19,682 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:19,682 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:19,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:19,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:19,683 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:19,683 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:19,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:19,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:19,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:19,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:19,683 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 06:55:19,683 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 06:55:19,683 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 06:55:19,683 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:19,684 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 06:55:19,684 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:19,684 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. started... 2023-10-30 06:55:19,687 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:19,687 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. started... 2023-10-30 06:55:19,687 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92d81501e99ecb332aa05a4d435c4bd1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 06:55:19,687 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:55:19,688 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:19,688 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0de074978d93be6422cc45784f698210 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 06:55:19,688 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. started... 2023-10-30 06:55:19,688 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:19,688 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 35f25523e5b1e828eda38c732550fbcb 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 06:55:20,137 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030f2f332d6edba4bffb965a360888976f0 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030f2f332d6edba4bffb965a360888976f0 2023-10-30 06:55:20,137 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030211f520f0a654ac9b2c5d010bf0c818b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030211f520f0a654ac9b2c5d010bf0c818b 2023-10-30 06:55:20,142 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030aa11c68e1f3648deb55b308b5d88cbd8 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030aa11c68e1f3648deb55b308b5d88cbd8 2023-10-30 06:55:20,150 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family1/8ef76e345fce4db1b32447fd7e3dfeab 2023-10-30 06:55:20,151 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family1/94e2361e3a1a424792517b8bf75db21e 2023-10-30 06:55:20,556 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family1/0880e35ac2df49cb94c49c1043b8e93b 2023-10-30 06:55:20,582 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030b9d7f155716e43fca0c0fb0a4f6a337c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231030b9d7f155716e43fca0c0fb0a4f6a337c 2023-10-30 06:55:20,583 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310300bba2b85c9ef41c491cd21a291fc1964 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202310300bba2b85c9ef41c491cd21a291fc1964 2023-10-30 06:55:20,595 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family2/c87e4737a235464cbcad3cf507070bfd 2023-10-30 06:55:20,599 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family1/8ef76e345fce4db1b32447fd7e3dfeab as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/8ef76e345fce4db1b32447fd7e3dfeab 2023-10-30 06:55:20,628 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/8ef76e345fce4db1b32447fd7e3dfeab, entries=4, sequenceid=5, filesize=5.5 K 2023-10-30 06:55:20,629 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family2/c87e4737a235464cbcad3cf507070bfd as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/c87e4737a235464cbcad3cf507070bfd 2023-10-30 06:55:20,633 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/c87e4737a235464cbcad3cf507070bfd, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 06:55:20,634 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0de074978d93be6422cc45784f698210 in 946ms, sequenceid=5, compaction requested=false 2023-10-30 06:55:20,634 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-10-30 06:55:20,634 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0de074978d93be6422cc45784f698210: 2023-10-30 06:55:20,634 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:20,634 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:55:20,994 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family2/b55ebeb97f5a48e5999a7148824b9314 2023-10-30 06:55:20,999 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030ae7100bcc1204d8e87161f806442c299 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231030ae7100bcc1204d8e87161f806442c299 2023-10-30 06:55:21,002 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family1/94e2361e3a1a424792517b8bf75db21e as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/94e2361e3a1a424792517b8bf75db21e 2023-10-30 06:55:21,027 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/94e2361e3a1a424792517b8bf75db21e, entries=4, sequenceid=5, filesize=5.5 K 2023-10-30 06:55:21,028 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family2/b55ebeb97f5a48e5999a7148824b9314 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/b55ebeb97f5a48e5999a7148824b9314 2023-10-30 06:55:21,032 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/b55ebeb97f5a48e5999a7148824b9314, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 06:55:21,032 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 35f25523e5b1e828eda38c732550fbcb in 1344ms, sequenceid=5, compaction requested=false 2023-10-30 06:55:21,033 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 35f25523e5b1e828eda38c732550fbcb: 2023-10-30 06:55:21,033 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:21,033 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:55:21,406 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family2/b05d6992f53d4ca7b1d78fc0c950f0be 2023-10-30 06:55:21,417 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family1/0880e35ac2df49cb94c49c1043b8e93b as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/0880e35ac2df49cb94c49c1043b8e93b 2023-10-30 06:55:21,441 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/0880e35ac2df49cb94c49c1043b8e93b, entries=4, sequenceid=5, filesize=5.5 K 2023-10-30 06:55:21,441 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family2/b05d6992f53d4ca7b1d78fc0c950f0be as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/b05d6992f53d4ca7b1d78fc0c950f0be 2023-10-30 06:55:21,444 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/b05d6992f53d4ca7b1d78fc0c950f0be, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 06:55:21,445 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 92d81501e99ecb332aa05a4d435c4bd1 in 1758ms, sequenceid=5, compaction requested=false 2023-10-30 06:55:21,445 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92d81501e99ecb332aa05a4d435c4bd1: 2023-10-30 06:55:21,445 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:21,445 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:55:21,445 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:55:21,445 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,445 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 06:55:21,445 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 06:55:21,446 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:21,446 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:21,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:21,446 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:21,447 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:21,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:21,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:21,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:21,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:21,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 06:55:21,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75714c0a[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:21,448 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 06:55:21,448 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:21,449 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:21,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:21,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:21,449 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 06:55:21,449 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 06:55:21,449 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:21,449 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,449 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:21,450 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,450 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 06:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:21,450 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:21,450 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 06:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:21,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:21,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:21,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:21,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:21,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 06:55:21,452 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 06:55:21,452 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:21,452 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:21,452 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 06:55:21,452 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:21,453 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:21,453 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:21,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:21,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:21,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:21,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:21,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:21,453 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:21,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:21,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:21,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:21,454 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:21,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:21,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:21,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:21,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,455 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:21,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:21,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,457 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,457 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:21,457 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:21,457 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 06:55:21,457 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:21,457 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:21,457 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:21,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:21,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:21,457 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:21,457 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:21,457 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,457 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:21,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:21,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:21,457 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:21,457 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:21,458 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:21,557 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:21,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:21,561 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:55:21,562 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:55:21,562 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:55:21,568 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:21,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-30 06:55:21,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 06:55:21,572 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 06:55:21,572 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:21,572 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 06:55:21,572 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 06:55:21,573 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:21,573 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:21,574 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,574 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:21,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:21,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:21,575 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:21,575 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:21,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:21,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:21,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:21,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:21,576 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 06:55:21,577 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-30 06:55:21,577 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 06:55:21,577 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 06:55:21,577 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:21,577 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 06:55:21,578 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:21,578 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. started... 2023-10-30 06:55:21,578 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:55:21,578 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:21,578 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:21,578 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:21,578 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. started... 2023-10-30 06:55:21,578 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. started... 2023-10-30 06:55:21,578 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92d81501e99ecb332aa05a4d435c4bd1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 06:55:21,578 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 35f25523e5b1e828eda38c732550fbcb 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 06:55:21,578 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0de074978d93be6422cc45784f698210 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 06:55:22,018 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030f2fd3ca722d34bbe9c74afd40a81d0cd to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030f2fd3ca722d34bbe9c74afd40a81d0cd 2023-10-30 06:55:22,018 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030fb1397382f02463d849d6fca559948d0 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030fb1397382f02463d849d6fca559948d0 2023-10-30 06:55:22,020 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310305c546e920a6f43b5bc113e568ab19531 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310305c546e920a6f43b5bc113e568ab19531 2023-10-30 06:55:22,432 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family1/910b87cde86643ab8e6902800af6704f 2023-10-30 06:55:22,433 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family1/dde8e13f59824bc4b8e6dfa1a163ecdb 2023-10-30 06:55:22,433 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family1/f5d539a6ec114d9e9c92d45e71df6a16 2023-10-30 06:55:22,481 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103081bdaa320c9e4aaf969f02d5988abc98 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023103081bdaa320c9e4aaf969f02d5988abc98 2023-10-30 06:55:22,482 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030edf85978a3a74ce89988313ef0868049 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231030edf85978a3a74ce89988313ef0868049 2023-10-30 06:55:22,885 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103049166790ad474b7db78dafd87245b12b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023103049166790ad474b7db78dafd87245b12b 2023-10-30 06:55:22,886 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family2/3044f71b6b96434d8367d1ac057a1383 2023-10-30 06:55:22,886 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family2/9cfb357e5e0047d4b9e45462cfc599a2 2023-10-30 06:55:22,891 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family2/44223ab6a42f452fae89ccf509a71c3c 2023-10-30 06:55:22,892 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family1/dde8e13f59824bc4b8e6dfa1a163ecdb as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/dde8e13f59824bc4b8e6dfa1a163ecdb 2023-10-30 06:55:22,892 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family1/f5d539a6ec114d9e9c92d45e71df6a16 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/f5d539a6ec114d9e9c92d45e71df6a16 2023-10-30 06:55:22,896 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family1/910b87cde86643ab8e6902800af6704f as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/910b87cde86643ab8e6902800af6704f 2023-10-30 06:55:22,913 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/dde8e13f59824bc4b8e6dfa1a163ecdb, entries=4, sequenceid=9, filesize=5.5 K 2023-10-30 06:55:22,914 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family2/3044f71b6b96434d8367d1ac057a1383 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/3044f71b6b96434d8367d1ac057a1383 2023-10-30 06:55:22,917 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/3044f71b6b96434d8367d1ac057a1383, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 06:55:22,917 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/f5d539a6ec114d9e9c92d45e71df6a16, entries=4, sequenceid=9, filesize=5.5 K 2023-10-30 06:55:22,917 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0de074978d93be6422cc45784f698210 in 1339ms, sequenceid=9, compaction requested=false 2023-10-30 06:55:22,918 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0de074978d93be6422cc45784f698210: 2023-10-30 06:55:22,918 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:22,918 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:55:22,918 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/910b87cde86643ab8e6902800af6704f, entries=4, sequenceid=9, filesize=5.5 K 2023-10-30 06:55:22,918 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family2/9cfb357e5e0047d4b9e45462cfc599a2 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/9cfb357e5e0047d4b9e45462cfc599a2 2023-10-30 06:55:22,919 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family2/44223ab6a42f452fae89ccf509a71c3c as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/44223ab6a42f452fae89ccf509a71c3c 2023-10-30 06:55:22,921 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/9cfb357e5e0047d4b9e45462cfc599a2, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 06:55:22,921 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/44223ab6a42f452fae89ccf509a71c3c, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 06:55:22,922 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 92d81501e99ecb332aa05a4d435c4bd1 in 1344ms, sequenceid=9, compaction requested=false 2023-10-30 06:55:22,922 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 35f25523e5b1e828eda38c732550fbcb in 1344ms, sequenceid=9, compaction requested=false 2023-10-30 06:55:22,922 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92d81501e99ecb332aa05a4d435c4bd1: 2023-10-30 06:55:22,922 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 35f25523e5b1e828eda38c732550fbcb: 2023-10-30 06:55:22,922 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:22,922 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:22,922 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:55:22,922 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:55:22,922 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:55:22,922 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,922 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 06:55:22,922 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 06:55:22,923 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,923 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:22,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:22,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:22,923 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:22,923 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:22,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:22,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:22,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:22,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:22,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 06:55:22,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29469de9[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:22,924 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 06:55:22,924 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:22,925 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:22,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:22,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:22,925 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 06:55:22,925 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 06:55:22,925 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:22,925 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,925 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:22,925 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 06:55:22,926 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,926 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:22,926 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 06:55:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:22,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 06:55:22,927 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 06:55:22,927 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:22,927 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:22,927 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 06:55:22,927 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:22,928 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:22,928 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:22,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:22,928 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:22,928 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:22,929 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:22,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:22,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,931 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,931 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:22,931 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:22,931 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:22,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:22,931 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 06:55:22,931 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:22,931 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:22,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-30 06:55:22,931 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:22,931 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:22,931 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:22,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:22,931 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:22,931 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:22,931 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:22,931 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:23,031 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:23,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:23,034 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:55:23,035 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:55:23,035 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:55:23,039 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:23,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-30 06:55:23,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 06:55:23,041 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 06:55:23,041 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:23,041 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 06:55:23,041 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 06:55:23,042 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:23,042 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:23,043 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:23,043 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:23,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:23,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:23,044 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:23,044 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:23,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:23,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:23,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:23,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:23,045 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 06:55:23,045 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-30 06:55:23,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 06:55:23,045 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 06:55:23,045 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:23,045 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 06:55:23,045 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:23,045 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. started... 2023-10-30 06:55:23,045 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:23,046 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:55:23,046 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:23,046 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:23,046 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92d81501e99ecb332aa05a4d435c4bd1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 06:55:23,046 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. started... 2023-10-30 06:55:23,046 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. started... 2023-10-30 06:55:23,046 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0de074978d93be6422cc45784f698210 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 06:55:23,046 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 35f25523e5b1e828eda38c732550fbcb 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 06:55:23,088 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030babfe15faac742e28841528270b323e7 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030babfe15faac742e28841528270b323e7 2023-10-30 06:55:23,091 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030882e2695b4fe430bb5fd6eed5bb26b60 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030882e2695b4fe430bb5fd6eed5bb26b60 2023-10-30 06:55:23,501 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family1/74ddd20127ea4824bb362637837a97d2 2023-10-30 06:55:23,501 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030ef7ec505022246559079204fa21f2e9d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030ef7ec505022246559079204fa21f2e9d 2023-10-30 06:55:23,502 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family1/6d1a2b99603c4fc5b13a8e90d6266723 2023-10-30 06:55:23,514 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family1/fabfc5339d2c445d931805af7baee78e 2023-10-30 06:55:23,947 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310305ac3d7401e0e4708befef0f783402d46 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310305ac3d7401e0e4708befef0f783402d46 2023-10-30 06:55:23,949 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030e227843fbc6149019c791f6eb3a2ea1f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231030e227843fbc6149019c791f6eb3a2ea1f 2023-10-30 06:55:23,959 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103030f04be6086241adac15ec2074816433 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023103030f04be6086241adac15ec2074816433 2023-10-30 06:55:23,965 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family2/678fc24b87c64b09b0547b8c43b40fe9 2023-10-30 06:55:23,969 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family1/fabfc5339d2c445d931805af7baee78e as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/fabfc5339d2c445d931805af7baee78e 2023-10-30 06:55:23,995 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/fabfc5339d2c445d931805af7baee78e, entries=4, sequenceid=13, filesize=5.5 K 2023-10-30 06:55:23,995 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family2/678fc24b87c64b09b0547b8c43b40fe9 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/678fc24b87c64b09b0547b8c43b40fe9 2023-10-30 06:55:23,999 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/678fc24b87c64b09b0547b8c43b40fe9, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 06:55:24,000 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 92d81501e99ecb332aa05a4d435c4bd1 in 954ms, sequenceid=13, compaction requested=true 2023-10-30 06:55:24,000 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92d81501e99ecb332aa05a4d435c4bd1: 2023-10-30 06:55:24,000 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:24,000 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:55:24,255 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 06:55:24,365 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family2/b1f8fa544d6841c984ef5bb6176ce02a 2023-10-30 06:55:24,368 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family2/31fce24bda4248cbb04c73f23c93c806 2023-10-30 06:55:24,371 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family1/6d1a2b99603c4fc5b13a8e90d6266723 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/6d1a2b99603c4fc5b13a8e90d6266723 2023-10-30 06:55:24,373 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family1/74ddd20127ea4824bb362637837a97d2 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/74ddd20127ea4824bb362637837a97d2 2023-10-30 06:55:24,393 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/74ddd20127ea4824bb362637837a97d2, entries=4, sequenceid=13, filesize=5.5 K 2023-10-30 06:55:24,394 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family2/31fce24bda4248cbb04c73f23c93c806 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/31fce24bda4248cbb04c73f23c93c806 2023-10-30 06:55:24,398 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/31fce24bda4248cbb04c73f23c93c806, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 06:55:24,398 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0de074978d93be6422cc45784f698210 in 1352ms, sequenceid=13, compaction requested=true 2023-10-30 06:55:24,398 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0de074978d93be6422cc45784f698210: 2023-10-30 06:55:24,399 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:24,399 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:55:24,399 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/6d1a2b99603c4fc5b13a8e90d6266723, entries=4, sequenceid=13, filesize=5.5 K 2023-10-30 06:55:24,400 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family2/b1f8fa544d6841c984ef5bb6176ce02a as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/b1f8fa544d6841c984ef5bb6176ce02a 2023-10-30 06:55:24,403 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/b1f8fa544d6841c984ef5bb6176ce02a, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 06:55:24,404 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 35f25523e5b1e828eda38c732550fbcb in 1358ms, sequenceid=13, compaction requested=true 2023-10-30 06:55:24,404 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 35f25523e5b1e828eda38c732550fbcb: 2023-10-30 06:55:24,404 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:24,404 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:55:24,404 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:55:24,404 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,404 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 06:55:24,404 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 06:55:24,405 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:24,405 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:24,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:24,405 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:24,405 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:24,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 06:55:24,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f4576dc[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:24,406 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 06:55:24,406 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:24,407 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:24,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:24,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:24,407 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 06:55:24,407 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 06:55:24,407 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:24,407 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,407 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:24,408 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,408 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 06:55:24,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,408 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:24,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:24,408 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 06:55:24,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:24,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:24,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:24,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 06:55:24,410 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 06:55:24,410 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:24,410 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:24,410 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 06:55:24,410 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:24,411 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:24,411 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:24,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:24,411 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:24,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:24,411 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:24,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:24,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:24,412 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:24,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:24,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,415 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,415 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:24,415 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:24,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:24,415 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 06:55:24,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-30 06:55:24,415 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:24,415 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:24,415 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:24,415 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:24,415 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,415 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:24,415 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:24,415 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:24,415 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:24,415 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:24,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:24,515 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:24,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:24,518 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:55:24,518 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:55:24,518 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 06:55:24,520 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:24,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-30 06:55:24,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 06:55:24,523 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 06:55:24,523 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:24,523 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 06:55:24,523 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 06:55:24,523 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:24,524 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:24,524 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:24,524 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:24,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:24,524 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:24,525 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:24,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:24,525 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 06:55:24,525 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-30 06:55:24,525 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 06:55:24,525 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 06:55:24,525 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:24,525 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 06:55:24,526 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:24,526 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. started... 2023-10-30 06:55:24,526 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92d81501e99ecb332aa05a4d435c4bd1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 06:55:24,526 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:24,526 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. started... 2023-10-30 06:55:24,526 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:55:24,526 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:24,526 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:24,526 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0de074978d93be6422cc45784f698210 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 06:55:24,526 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. started... 2023-10-30 06:55:24,527 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 35f25523e5b1e828eda38c732550fbcb 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 06:55:24,565 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310306dd92221a52c4ab6a19ffee63a63bfd6 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310306dd92221a52c4ab6a19ffee63a63bfd6 2023-10-30 06:55:24,566 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103094b633495d86486b8a991cf873502d36 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103094b633495d86486b8a991cf873502d36 2023-10-30 06:55:24,578 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family1/d739ffd023d84c4384725059b488908f 2023-10-30 06:55:24,968 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310309ac9bcb5144d40019ff58aecb4a7d508 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310309ac9bcb5144d40019ff58aecb4a7d508 2023-10-30 06:55:24,980 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family1/29a60c476d1f4878b8cb4ec76c0cb208 2023-10-30 06:55:25,019 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310300c55ca910dbb48fcb4de880b45084c09 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202310300c55ca910dbb48fcb4de880b45084c09 2023-10-30 06:55:25,023 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family2/5ebeb75db8c04668a3c314c69b8467d9 2023-10-30 06:55:25,027 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family1/d739ffd023d84c4384725059b488908f as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/d739ffd023d84c4384725059b488908f 2023-10-30 06:55:25,051 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/d739ffd023d84c4384725059b488908f, entries=4, sequenceid=17, filesize=5.5 K 2023-10-30 06:55:25,052 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family2/5ebeb75db8c04668a3c314c69b8467d9 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/5ebeb75db8c04668a3c314c69b8467d9 2023-10-30 06:55:25,055 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/5ebeb75db8c04668a3c314c69b8467d9, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 06:55:25,056 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0de074978d93be6422cc45784f698210 in 530ms, sequenceid=17, compaction requested=true 2023-10-30 06:55:25,056 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0de074978d93be6422cc45784f698210: 2023-10-30 06:55:25,056 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:25,056 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:55:25,380 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family1/fa4f63719e194093a2dda8fe48cfd88a 2023-10-30 06:55:25,410 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030893b0fb120d9446e810f7dbee383dc17 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231030893b0fb120d9446e810f7dbee383dc17 2023-10-30 06:55:25,411 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030fbd346231ee9471d906e0de1299f375e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231030fbd346231ee9471d906e0de1299f375e 2023-10-30 06:55:25,814 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family2/5ce855a187df41cb8097457ad6dfdce3 2023-10-30 06:55:25,815 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family2/c00a4a59d5fb464ab841140d7729dc3e 2023-10-30 06:55:25,820 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family1/29a60c476d1f4878b8cb4ec76c0cb208 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/29a60c476d1f4878b8cb4ec76c0cb208 2023-10-30 06:55:25,821 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family1/fa4f63719e194093a2dda8fe48cfd88a as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/fa4f63719e194093a2dda8fe48cfd88a 2023-10-30 06:55:25,856 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/29a60c476d1f4878b8cb4ec76c0cb208, entries=4, sequenceid=17, filesize=5.5 K 2023-10-30 06:55:25,858 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family2/5ce855a187df41cb8097457ad6dfdce3 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/5ce855a187df41cb8097457ad6dfdce3 2023-10-30 06:55:25,861 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/fa4f63719e194093a2dda8fe48cfd88a, entries=4, sequenceid=17, filesize=5.5 K 2023-10-30 06:55:25,863 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family2/c00a4a59d5fb464ab841140d7729dc3e as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/c00a4a59d5fb464ab841140d7729dc3e 2023-10-30 06:55:25,863 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/5ce855a187df41cb8097457ad6dfdce3, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 06:55:25,864 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 92d81501e99ecb332aa05a4d435c4bd1 in 1338ms, sequenceid=17, compaction requested=true 2023-10-30 06:55:25,864 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92d81501e99ecb332aa05a4d435c4bd1: 2023-10-30 06:55:25,864 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:25,864 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:55:25,866 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/c00a4a59d5fb464ab841140d7729dc3e, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 06:55:25,867 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 35f25523e5b1e828eda38c732550fbcb in 1340ms, sequenceid=17, compaction requested=true 2023-10-30 06:55:25,867 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 35f25523e5b1e828eda38c732550fbcb: 2023-10-30 06:55:25,867 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:25,867 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:55:25,867 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:55:25,867 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,867 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 06:55:25,867 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 06:55:25,868 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:25,868 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:25,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:25,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:25,869 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:25,869 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:25,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:25,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:25,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:25,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 06:55:25,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77431227[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:25,870 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 06:55:25,870 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:25,871 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:25,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:25,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:25,871 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 06:55:25,871 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 06:55:25,871 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:25,871 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,871 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:25,871 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 06:55:25,871 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,871 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:25,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:25,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:25,871 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 06:55:25,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:25,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:25,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:25,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:25,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:25,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:25,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 06:55:25,873 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 06:55:25,873 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:25,873 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:25,873 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 06:55:25,873 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:25,874 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:25,874 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:25,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:25,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:25,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:25,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:25,874 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:25,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:25,875 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:25,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:25,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:25,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:25,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:25,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:25,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:25,875 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,877 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,877 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:25,877 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:25,877 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:25,877 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 06:55:25,877 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:25,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:25,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-30 06:55:25,877 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:25,877 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:25,877 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:25,877 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:25,878 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:25,878 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:25,878 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:25,878 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:25,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:25,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:25,977 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:25,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:25,989 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:55:25,996 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:55:26,003 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:55:26,004 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:55:26,081 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-30 06:55:26,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-30 06:55:26,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 06:55:26,083 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 06:55:26,083 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:26,083 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 06:55:26,083 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 06:55:26,084 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:26,084 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:26,084 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:26,084 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:26,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:26,085 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:26,085 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 06:55:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:26,085 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 06:55:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:26,085 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 06:55:26,086 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-30 06:55:26,086 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 06:55:26,086 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 06:55:26,086 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 06:55:26,086 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 06:55:26,086 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:26,086 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. started... 2023-10-30 06:55:26,086 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92d81501e99ecb332aa05a4d435c4bd1 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 06:55:26,090 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:26,090 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 06:55:26,090 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 06:55:26,090 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:26,090 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. started... 2023-10-30 06:55:26,091 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. started... 2023-10-30 06:55:26,091 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0de074978d93be6422cc45784f698210 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 06:55:26,091 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 35f25523e5b1e828eda38c732550fbcb 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 06:55:26,534 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family1/866def1ed6394dfe9a441bacb69ca5ad 2023-10-30 06:55:26,554 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 866def1ed6394dfe9a441bacb69ca5ad 2023-10-30 06:55:26,932 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family1/ab9b714751d64ac39b649c2f346e4fca 2023-10-30 06:55:26,936 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family1/9b7d1dc564984846b8fd267249da6781 2023-10-30 06:55:26,955 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9b7d1dc564984846b8fd267249da6781 2023-10-30 06:55:26,961 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab9b714751d64ac39b649c2f346e4fca 2023-10-30 06:55:27,366 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family2/7bb05b96e7b34014a261247ef0041a23 2023-10-30 06:55:27,369 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7bb05b96e7b34014a261247ef0041a23 2023-10-30 06:55:27,370 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family1/9b7d1dc564984846b8fd267249da6781 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/9b7d1dc564984846b8fd267249da6781 2023-10-30 06:55:27,373 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family2/54aeaab1d76b4b1eb4fef27a47b61fc6 2023-10-30 06:55:27,380 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family2/de30229401e54d52845fff30e7611283 2023-10-30 06:55:27,381 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54aeaab1d76b4b1eb4fef27a47b61fc6 2023-10-30 06:55:27,382 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family1/866def1ed6394dfe9a441bacb69ca5ad as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/866def1ed6394dfe9a441bacb69ca5ad 2023-10-30 06:55:27,383 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de30229401e54d52845fff30e7611283 2023-10-30 06:55:27,383 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family1/ab9b714751d64ac39b649c2f346e4fca as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/ab9b714751d64ac39b649c2f346e4fca 2023-10-30 06:55:27,400 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9b7d1dc564984846b8fd267249da6781 2023-10-30 06:55:27,400 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/9b7d1dc564984846b8fd267249da6781, entries=3, sequenceid=23, filesize=5.2 K 2023-10-30 06:55:27,401 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family2/7bb05b96e7b34014a261247ef0041a23 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/7bb05b96e7b34014a261247ef0041a23 2023-10-30 06:55:27,412 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7bb05b96e7b34014a261247ef0041a23 2023-10-30 06:55:27,412 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/7bb05b96e7b34014a261247ef0041a23, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 06:55:27,413 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 866def1ed6394dfe9a441bacb69ca5ad 2023-10-30 06:55:27,413 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 35f25523e5b1e828eda38c732550fbcb in 1322ms, sequenceid=23, compaction requested=true 2023-10-30 06:55:27,413 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/866def1ed6394dfe9a441bacb69ca5ad, entries=3, sequenceid=23, filesize=5.2 K 2023-10-30 06:55:27,413 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 35f25523e5b1e828eda38c732550fbcb: 2023-10-30 06:55:27,413 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:27,413 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 06:55:27,414 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family2/54aeaab1d76b4b1eb4fef27a47b61fc6 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/54aeaab1d76b4b1eb4fef27a47b61fc6 2023-10-30 06:55:27,415 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab9b714751d64ac39b649c2f346e4fca 2023-10-30 06:55:27,415 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/ab9b714751d64ac39b649c2f346e4fca, entries=3, sequenceid=23, filesize=5.2 K 2023-10-30 06:55:27,419 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family2/de30229401e54d52845fff30e7611283 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/de30229401e54d52845fff30e7611283 2023-10-30 06:55:27,422 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54aeaab1d76b4b1eb4fef27a47b61fc6 2023-10-30 06:55:27,422 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/54aeaab1d76b4b1eb4fef27a47b61fc6, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 06:55:27,423 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0de074978d93be6422cc45784f698210 in 1332ms, sequenceid=23, compaction requested=true 2023-10-30 06:55:27,423 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0de074978d93be6422cc45784f698210: 2023-10-30 06:55:27,423 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:27,423 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 06:55:27,425 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de30229401e54d52845fff30e7611283 2023-10-30 06:55:27,425 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/de30229401e54d52845fff30e7611283, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 06:55:27,426 INFO [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 92d81501e99ecb332aa05a4d435c4bd1 in 1340ms, sequenceid=23, compaction requested=true 2023-10-30 06:55:27,426 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92d81501e99ecb332aa05a4d435c4bd1: 2023-10-30 06:55:27,426 DEBUG [rs(jenkins-hbase20.apache.org,40611,1698648765457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:27,426 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 06:55:27,426 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 06:55:27,426 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,426 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 06:55:27,426 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 06:55:27,427 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:27,427 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:27,428 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:27,428 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 06:55:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:27,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40611,1698648765457' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 06:55:27,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@82d01d9[Count = 0] remaining members to acquire global barrier 2023-10-30 06:55:27,429 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 06:55:27,429 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:27,430 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:27,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:27,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:27,430 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 06:55:27,430 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 06:55:27,430 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,40611,1698648765457' in zk 2023-10-30 06:55:27,431 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,431 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 06:55:27,431 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,431 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 06:55:27,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:27,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:27,431 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:27,431 DEBUG [member: 'jenkins-hbase20.apache.org,40611,1698648765457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 06:55:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,40611,1698648765457': 2023-10-30 06:55:27,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40611,1698648765457' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 06:55:27,433 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 06:55:27,433 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 06:55:27,433 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 06:55:27,433 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 06:55:27,433 INFO [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 06:55:27,434 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:27,434 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 06:55:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 06:55:27,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:27,434 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 06:55:27,434 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 06:55:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:27,436 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 06:55:27,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 06:55:27,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,437 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,437 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:27,437 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 06:55:27,437 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:27,437 DEBUG [(jenkins-hbase20.apache.org,37859,1698648764408)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 06:55:27,437 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 06:55:27,437 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:27,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 06:55:27,437 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 06:55:27,437 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 06:55:27,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-30 06:55:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 06:55:27,437 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 06:55:27,437 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 06:55:27,437 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 06:55:27,437 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 06:55:27,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 06:55:27,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 06:55:27,438 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 06:55:27,538 DEBUG [Listener at localhost/40811] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 06:55:27,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=37859] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 06:55:27,539 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:55:27,539 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): 92d81501e99ecb332aa05a4d435c4bd1/family1 is initiating major compaction (all files) 2023-10-30 06:55:27,539 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:55:27,539 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:55:27,540 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of 92d81501e99ecb332aa05a4d435c4bd1/family1 in testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:27,540 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/0880e35ac2df49cb94c49c1043b8e93b, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/f5d539a6ec114d9e9c92d45e71df6a16, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/fabfc5339d2c445d931805af7baee78e, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/29a60c476d1f4878b8cb4ec76c0cb208, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/ab9b714751d64ac39b649c2f346e4fca] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp, totalSize=27.1 K 2023-10-30 06:55:27,540 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 0880e35ac2df49cb94c49c1043b8e93b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648919675 2023-10-30 06:55:27,541 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting f5d539a6ec114d9e9c92d45e71df6a16, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648921561 2023-10-30 06:55:27,541 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting fabfc5339d2c445d931805af7baee78e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648923034 2023-10-30 06:55:27,541 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 29a60c476d1f4878b8cb4ec76c0cb208, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648924518 2023-10-30 06:55:27,541 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting ab9b714751d64ac39b649c2f346e4fca, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 06:55:27,555 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): 92d81501e99ecb332aa05a4d435c4bd1#family1#compaction#197 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:55:27,991 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310301f6af6532d5c40638f248e9e919671ea_del 2023-10-30 06:55:27,991 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310301f6af6532d5c40638f248e9e919671ea_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310301f6af6532d5c40638f248e9e919671ea_del 2023-10-30 06:55:28,842 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20e57d5c707545a79370287fe42e45ac 2023-10-30 06:55:28,843 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family1/20e57d5c707545a79370287fe42e45ac as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/20e57d5c707545a79370287fe42e45ac 2023-10-30 06:55:28,866 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20e57d5c707545a79370287fe42e45ac 2023-10-30 06:55:28,867 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 92d81501e99ecb332aa05a4d435c4bd1/family1 of 92d81501e99ecb332aa05a4d435c4bd1 into 20e57d5c707545a79370287fe42e45ac(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:55:28,867 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for 92d81501e99ecb332aa05a4d435c4bd1: 2023-10-30 06:55:28,867 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:55:28,867 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): 92d81501e99ecb332aa05a4d435c4bd1/family2 is initiating major compaction (all files) 2023-10-30 06:55:28,867 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:55:28,867 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:55:28,867 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of 92d81501e99ecb332aa05a4d435c4bd1/family2 in testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:28,868 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/b05d6992f53d4ca7b1d78fc0c950f0be, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/9cfb357e5e0047d4b9e45462cfc599a2, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/678fc24b87c64b09b0547b8c43b40fe9, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/5ce855a187df41cb8097457ad6dfdce3, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/de30229401e54d52845fff30e7611283] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp, totalSize=25.4 K 2023-10-30 06:55:28,868 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting b05d6992f53d4ca7b1d78fc0c950f0be, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648919675 2023-10-30 06:55:28,868 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 9cfb357e5e0047d4b9e45462cfc599a2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648921561 2023-10-30 06:55:28,869 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 678fc24b87c64b09b0547b8c43b40fe9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648923034 2023-10-30 06:55:28,869 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 5ce855a187df41cb8097457ad6dfdce3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648924518 2023-10-30 06:55:28,869 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting de30229401e54d52845fff30e7611283, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 06:55:28,877 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): 92d81501e99ecb332aa05a4d435c4bd1#family2#compaction#198 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:55:28,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/0880e35ac2df49cb94c49c1043b8e93b, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/f5d539a6ec114d9e9c92d45e71df6a16, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/fabfc5339d2c445d931805af7baee78e, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/29a60c476d1f4878b8cb4ec76c0cb208, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/ab9b714751d64ac39b649c2f346e4fca] to archive 2023-10-30 06:55:28,910 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:28,912 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/0880e35ac2df49cb94c49c1043b8e93b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/0880e35ac2df49cb94c49c1043b8e93b 2023-10-30 06:55:28,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/f5d539a6ec114d9e9c92d45e71df6a16 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/f5d539a6ec114d9e9c92d45e71df6a16 2023-10-30 06:55:28,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/fabfc5339d2c445d931805af7baee78e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/fabfc5339d2c445d931805af7baee78e 2023-10-30 06:55:28,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/29a60c476d1f4878b8cb4ec76c0cb208 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/29a60c476d1f4878b8cb4ec76c0cb208 2023-10-30 06:55:28,915 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/ab9b714751d64ac39b649c2f346e4fca to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/ab9b714751d64ac39b649c2f346e4fca 2023-10-30 06:55:29,305 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023103002790583eec44fe68779c4debe91c965_del 2023-10-30 06:55:29,305 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103002790583eec44fe68779c4debe91c965_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023103002790583eec44fe68779c4debe91c965_del 2023-10-30 06:55:29,322 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 67e467b9308a46eab91077a83c7a644a 2023-10-30 06:55:29,322 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/.tmp/family2/67e467b9308a46eab91077a83c7a644a as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/67e467b9308a46eab91077a83c7a644a 2023-10-30 06:55:29,327 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 67e467b9308a46eab91077a83c7a644a 2023-10-30 06:55:29,329 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 92d81501e99ecb332aa05a4d435c4bd1/family2 of 92d81501e99ecb332aa05a4d435c4bd1 into 67e467b9308a46eab91077a83c7a644a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:55:29,329 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for 92d81501e99ecb332aa05a4d435c4bd1: 2023-10-30 06:55:29,329 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:55:29,329 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): 0de074978d93be6422cc45784f698210/family1 is initiating major compaction (all files) 2023-10-30 06:55:29,330 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:55:29,330 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:55:29,331 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of 0de074978d93be6422cc45784f698210/family1 in testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:29,331 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/8ef76e345fce4db1b32447fd7e3dfeab, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/dde8e13f59824bc4b8e6dfa1a163ecdb, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/74ddd20127ea4824bb362637837a97d2, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/d739ffd023d84c4384725059b488908f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/866def1ed6394dfe9a441bacb69ca5ad] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp, totalSize=27.1 K 2023-10-30 06:55:29,332 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 8ef76e345fce4db1b32447fd7e3dfeab, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648919677 2023-10-30 06:55:29,332 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting dde8e13f59824bc4b8e6dfa1a163ecdb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648921562 2023-10-30 06:55:29,333 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 74ddd20127ea4824bb362637837a97d2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648923035 2023-10-30 06:55:29,333 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting d739ffd023d84c4384725059b488908f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648924518 2023-10-30 06:55:29,333 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 866def1ed6394dfe9a441bacb69ca5ad, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 06:55:29,352 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:55:29,352 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28f6fa48 to 127.0.0.1:50449 2023-10-30 06:55:29,352 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:55:29,352 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:55:29,352 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x705fdefc to 127.0.0.1:50449 2023-10-30 06:55:29,352 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:55:29,357 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): 0de074978d93be6422cc45784f698210#family1#compaction#199 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:55:29,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/b05d6992f53d4ca7b1d78fc0c950f0be, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/9cfb357e5e0047d4b9e45462cfc599a2, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/678fc24b87c64b09b0547b8c43b40fe9, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/5ce855a187df41cb8097457ad6dfdce3, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/de30229401e54d52845fff30e7611283] to archive 2023-10-30 06:55:29,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:29,414 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/b05d6992f53d4ca7b1d78fc0c950f0be to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/b05d6992f53d4ca7b1d78fc0c950f0be 2023-10-30 06:55:29,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/9cfb357e5e0047d4b9e45462cfc599a2 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/9cfb357e5e0047d4b9e45462cfc599a2 2023-10-30 06:55:29,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/678fc24b87c64b09b0547b8c43b40fe9 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/678fc24b87c64b09b0547b8c43b40fe9 2023-10-30 06:55:29,417 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/5ce855a187df41cb8097457ad6dfdce3 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/5ce855a187df41cb8097457ad6dfdce3 2023-10-30 06:55:29,419 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/de30229401e54d52845fff30e7611283 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family2/de30229401e54d52845fff30e7611283 2023-10-30 06:55:29,793 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023103054733efad61845db93d3d304795ad088_del 2023-10-30 06:55:29,793 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103054733efad61845db93d3d304795ad088_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023103054733efad61845db93d3d304795ad088_del 2023-10-30 06:55:30,644 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d1b87f39a3c046628c374d712fceb5de 2023-10-30 06:55:30,644 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family1/d1b87f39a3c046628c374d712fceb5de as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/d1b87f39a3c046628c374d712fceb5de 2023-10-30 06:55:30,663 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d1b87f39a3c046628c374d712fceb5de 2023-10-30 06:55:30,664 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0de074978d93be6422cc45784f698210/family1 of 0de074978d93be6422cc45784f698210 into d1b87f39a3c046628c374d712fceb5de(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:55:30,664 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for 0de074978d93be6422cc45784f698210: 2023-10-30 06:55:30,664 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:55:30,664 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): 0de074978d93be6422cc45784f698210/family2 is initiating major compaction (all files) 2023-10-30 06:55:30,665 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:55:30,665 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:55:30,665 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of 0de074978d93be6422cc45784f698210/family2 in testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:30,665 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/c87e4737a235464cbcad3cf507070bfd, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/3044f71b6b96434d8367d1ac057a1383, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/31fce24bda4248cbb04c73f23c93c806, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/5ebeb75db8c04668a3c314c69b8467d9, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/54aeaab1d76b4b1eb4fef27a47b61fc6] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp, totalSize=25.4 K 2023-10-30 06:55:30,665 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting c87e4737a235464cbcad3cf507070bfd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648919677 2023-10-30 06:55:30,666 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 3044f71b6b96434d8367d1ac057a1383, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648921562 2023-10-30 06:55:30,666 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 31fce24bda4248cbb04c73f23c93c806, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648923035 2023-10-30 06:55:30,666 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 5ebeb75db8c04668a3c314c69b8467d9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648924518 2023-10-30 06:55:30,667 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 54aeaab1d76b4b1eb4fef27a47b61fc6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 06:55:30,674 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): 0de074978d93be6422cc45784f698210#family2#compaction#200 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:55:30,714 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/8ef76e345fce4db1b32447fd7e3dfeab, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/dde8e13f59824bc4b8e6dfa1a163ecdb, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/74ddd20127ea4824bb362637837a97d2, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/d739ffd023d84c4384725059b488908f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/866def1ed6394dfe9a441bacb69ca5ad] to archive 2023-10-30 06:55:30,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:30,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/8ef76e345fce4db1b32447fd7e3dfeab to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/8ef76e345fce4db1b32447fd7e3dfeab 2023-10-30 06:55:30,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/dde8e13f59824bc4b8e6dfa1a163ecdb to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/dde8e13f59824bc4b8e6dfa1a163ecdb 2023-10-30 06:55:30,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/74ddd20127ea4824bb362637837a97d2 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/74ddd20127ea4824bb362637837a97d2 2023-10-30 06:55:30,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/d739ffd023d84c4384725059b488908f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/d739ffd023d84c4384725059b488908f 2023-10-30 06:55:30,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/866def1ed6394dfe9a441bacb69ca5ad to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/866def1ed6394dfe9a441bacb69ca5ad 2023-10-30 06:55:31,081 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231030877ad3bb21f24a11864a9b60688ef3d7_del 2023-10-30 06:55:31,081 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030877ad3bb21f24a11864a9b60688ef3d7_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231030877ad3bb21f24a11864a9b60688ef3d7_del 2023-10-30 06:55:31,502 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b648559c5a74ea9a7b75df19dd60eb8 2023-10-30 06:55:31,503 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/.tmp/family2/1b648559c5a74ea9a7b75df19dd60eb8 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/1b648559c5a74ea9a7b75df19dd60eb8 2023-10-30 06:55:31,508 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b648559c5a74ea9a7b75df19dd60eb8 2023-10-30 06:55:31,509 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0de074978d93be6422cc45784f698210/family2 of 0de074978d93be6422cc45784f698210 into 1b648559c5a74ea9a7b75df19dd60eb8(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:55:31,509 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for 0de074978d93be6422cc45784f698210: 2023-10-30 06:55:31,509 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:55:31,509 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): 35f25523e5b1e828eda38c732550fbcb/family1 is initiating major compaction (all files) 2023-10-30 06:55:31,510 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:55:31,510 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:55:31,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/c87e4737a235464cbcad3cf507070bfd, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/3044f71b6b96434d8367d1ac057a1383, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/31fce24bda4248cbb04c73f23c93c806, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/5ebeb75db8c04668a3c314c69b8467d9, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/54aeaab1d76b4b1eb4fef27a47b61fc6] to archive 2023-10-30 06:55:31,510 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of 35f25523e5b1e828eda38c732550fbcb/family1 in testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:31,510 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/94e2361e3a1a424792517b8bf75db21e, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/910b87cde86643ab8e6902800af6704f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/6d1a2b99603c4fc5b13a8e90d6266723, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/fa4f63719e194093a2dda8fe48cfd88a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/9b7d1dc564984846b8fd267249da6781] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp, totalSize=27.1 K 2023-10-30 06:55:31,511 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 94e2361e3a1a424792517b8bf75db21e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648919676 2023-10-30 06:55:31,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:31,511 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 910b87cde86643ab8e6902800af6704f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648921562 2023-10-30 06:55:31,511 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 6d1a2b99603c4fc5b13a8e90d6266723, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648923035 2023-10-30 06:55:31,511 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting fa4f63719e194093a2dda8fe48cfd88a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648924518 2023-10-30 06:55:31,512 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 9b7d1dc564984846b8fd267249da6781, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 06:55:31,512 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/c87e4737a235464cbcad3cf507070bfd to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/c87e4737a235464cbcad3cf507070bfd 2023-10-30 06:55:31,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/3044f71b6b96434d8367d1ac057a1383 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/3044f71b6b96434d8367d1ac057a1383 2023-10-30 06:55:31,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/31fce24bda4248cbb04c73f23c93c806 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/31fce24bda4248cbb04c73f23c93c806 2023-10-30 06:55:31,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/5ebeb75db8c04668a3c314c69b8467d9 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/5ebeb75db8c04668a3c314c69b8467d9 2023-10-30 06:55:31,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/54aeaab1d76b4b1eb4fef27a47b61fc6 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family2/54aeaab1d76b4b1eb4fef27a47b61fc6 2023-10-30 06:55:31,519 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): 35f25523e5b1e828eda38c732550fbcb#family1#compaction#201 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:55:31,957 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030156a179ef95349b0849bd5c4a48c86bd_del 2023-10-30 06:55:31,957 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030156a179ef95349b0849bd5c4a48c86bd_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030156a179ef95349b0849bd5c4a48c86bd_del 2023-10-30 06:55:32,804 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a2613c040e6b4fcca6e412878542d083 2023-10-30 06:55:32,805 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family1/a2613c040e6b4fcca6e412878542d083 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/a2613c040e6b4fcca6e412878542d083 2023-10-30 06:55:32,828 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a2613c040e6b4fcca6e412878542d083 2023-10-30 06:55:32,829 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 35f25523e5b1e828eda38c732550fbcb/family1 of 35f25523e5b1e828eda38c732550fbcb into a2613c040e6b4fcca6e412878542d083(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 06:55:32,830 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for 35f25523e5b1e828eda38c732550fbcb: 2023-10-30 06:55:32,830 DEBUG [Listener at localhost/40811] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 06:55:32,830 DEBUG [Listener at localhost/40811] regionserver.HStore(1912): 35f25523e5b1e828eda38c732550fbcb/family2 is initiating major compaction (all files) 2023-10-30 06:55:32,830 INFO [Listener at localhost/40811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 06:55:32,830 INFO [Listener at localhost/40811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 06:55:32,830 INFO [Listener at localhost/40811] regionserver.HRegion(2259): Starting compaction of 35f25523e5b1e828eda38c732550fbcb/family2 in testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:32,830 INFO [Listener at localhost/40811] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/b55ebeb97f5a48e5999a7148824b9314, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/44223ab6a42f452fae89ccf509a71c3c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/b1f8fa544d6841c984ef5bb6176ce02a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/c00a4a59d5fb464ab841140d7729dc3e, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/7bb05b96e7b34014a261247ef0041a23] into tmpdir=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp, totalSize=25.4 K 2023-10-30 06:55:32,830 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting b55ebeb97f5a48e5999a7148824b9314, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698648919676 2023-10-30 06:55:32,831 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 44223ab6a42f452fae89ccf509a71c3c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698648921562 2023-10-30 06:55:32,831 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting b1f8fa544d6841c984ef5bb6176ce02a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698648923035 2023-10-30 06:55:32,831 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting c00a4a59d5fb464ab841140d7729dc3e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698648924518 2023-10-30 06:55:32,832 DEBUG [Listener at localhost/40811] compactions.Compactor(207): Compacting 7bb05b96e7b34014a261247ef0041a23, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 06:55:32,839 INFO [Listener at localhost/40811] throttle.PressureAwareThroughputController(145): 35f25523e5b1e828eda38c732550fbcb#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 06:55:32,910 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/94e2361e3a1a424792517b8bf75db21e, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/910b87cde86643ab8e6902800af6704f, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/6d1a2b99603c4fc5b13a8e90d6266723, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/fa4f63719e194093a2dda8fe48cfd88a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/9b7d1dc564984846b8fd267249da6781] to archive 2023-10-30 06:55:32,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:32,912 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/94e2361e3a1a424792517b8bf75db21e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/94e2361e3a1a424792517b8bf75db21e 2023-10-30 06:55:32,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/910b87cde86643ab8e6902800af6704f to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/910b87cde86643ab8e6902800af6704f 2023-10-30 06:55:32,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/6d1a2b99603c4fc5b13a8e90d6266723 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/6d1a2b99603c4fc5b13a8e90d6266723 2023-10-30 06:55:32,915 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/fa4f63719e194093a2dda8fe48cfd88a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/fa4f63719e194093a2dda8fe48cfd88a 2023-10-30 06:55:32,916 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/9b7d1dc564984846b8fd267249da6781 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/9b7d1dc564984846b8fd267249da6781 2023-10-30 06:55:33,253 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030192eb6c0a62348c586e6aef05943a544_del 2023-10-30 06:55:33,253 INFO [Listener at localhost/40811] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030192eb6c0a62348c586e6aef05943a544_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231030192eb6c0a62348c586e6aef05943a544_del 2023-10-30 06:55:33,676 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20d55634f74e4f4d8bf17b33e57a2116 2023-10-30 06:55:33,677 DEBUG [Listener at localhost/40811] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/.tmp/family2/20d55634f74e4f4d8bf17b33e57a2116 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/20d55634f74e4f4d8bf17b33e57a2116 2023-10-30 06:55:33,682 INFO [Listener at localhost/40811] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20d55634f74e4f4d8bf17b33e57a2116 2023-10-30 06:55:33,683 INFO [Listener at localhost/40811] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 35f25523e5b1e828eda38c732550fbcb/family2 of 35f25523e5b1e828eda38c732550fbcb into 20d55634f74e4f4d8bf17b33e57a2116(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 06:55:33,683 DEBUG [Listener at localhost/40811] regionserver.HRegion(2289): Compaction status journal for 35f25523e5b1e828eda38c732550fbcb: 2023-10-30 06:55:33,687 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:55:33,692 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:55:33,697 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:55:33,698 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:55:33,703 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37859] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10XM\xEF\x83\xA2#\x8AZ\x12\x1D\x88\xB2\xF1\xFDc\xD4"\x10\xFD+Th\xFD\x16\x85\xA3\xD0\x09\xE2\xD6\xB9&\x81\xDE*\x10B\x853\x0C\x98b\x16\xFE53\x90y\xF2&\xDA\x9C2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-10-30 06:55:33,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/b55ebeb97f5a48e5999a7148824b9314, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/44223ab6a42f452fae89ccf509a71c3c, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/b1f8fa544d6841c984ef5bb6176ce02a, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/c00a4a59d5fb464ab841140d7729dc3e, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/7bb05b96e7b34014a261247ef0041a23] to archive 2023-10-30 06:55:33,711 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:33,713 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/b55ebeb97f5a48e5999a7148824b9314 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/b55ebeb97f5a48e5999a7148824b9314 2023-10-30 06:55:33,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/44223ab6a42f452fae89ccf509a71c3c to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/44223ab6a42f452fae89ccf509a71c3c 2023-10-30 06:55:33,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/b1f8fa544d6841c984ef5bb6176ce02a to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/b1f8fa544d6841c984ef5bb6176ce02a 2023-10-30 06:55:33,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/c00a4a59d5fb464ab841140d7729dc3e to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/c00a4a59d5fb464ab841140d7729dc3e 2023-10-30 06:55:33,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/7bb05b96e7b34014a261247ef0041a23 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family2/7bb05b96e7b34014a261247ef0041a23 2023-10-30 06:55:33,725 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-30 06:55:33,726 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-30 06:55:33,726 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:55:33,726 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698649533726 2023-10-30 06:55:33,727 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 06:55:34,057 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-10-30 06:55:34,085 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310301f6af6532d5c40638f248e9e919671ea_del 2023-10-30 06:55:34,105 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030156a179ef95349b0849bd5c4a48c86bd_del 2023-10-30 06:55:34,128 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023103054733efad61845db93d3d304795ad088_del 2023-10-30 06:55:34,128 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 06:55:34,129 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] zookeeper.ReadOnlyZKClient(139): Connect 0x6f8edb6b to 127.0.0.1:50449 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 06:55:34,133 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7760104c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 06:55:34,133 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 06:55:35,082 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030ad004dc27b1b478ba0c2da6bd2760ad1 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030ad004dc27b1b478ba0c2da6bd2760ad1 2023-10-30 06:55:35,083 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 06:55:35,093 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 06:55:35,095 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 06:55:35,106 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 06:55:35,108 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 06:55:35,136 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030/family1/ec3ab67eae1c4078a7ca0808b7d026ed first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-10-30 06:55:35,136 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030/family1/ec3ab67eae1c4078a7ca0808b7d026ed}] 2023-10-30 06:55:35,142 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030/family1/ec3ab67eae1c4078a7ca0808b7d026ed for inclusion in 0de074978d93be6422cc45784f698210/family1 2023-10-30 06:55:35,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-10-30 06:55:35,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 06:55:35,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 0de074978d93be6422cc45784f698210: 2023-10-30 06:55:35,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030/family1/ec3ab67eae1c4078a7ca0808b7d026ed to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__o0mtvmq28bq493mtdl1isofch596sh9mdo35vc4iphtss0aecepksvhfblhiuvop/family1/ec3ab67eae1c4078a7ca0808b7d026ed 2023-10-30 06:55:35,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__o0mtvmq28bq493mtdl1isofch596sh9mdo35vc4iphtss0aecepksvhfblhiuvop/family1/ec3ab67eae1c4078a7ca0808b7d026ed as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/3fe76625ffeb4378967cbda00ae01380_SeqId_28_ 2023-10-30 06:55:35,173 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__o0mtvmq28bq493mtdl1isofch596sh9mdo35vc4iphtss0aecepksvhfblhiuvop/family1/ec3ab67eae1c4078a7ca0808b7d026ed into 0de074978d93be6422cc45784f698210/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/3fe76625ffeb4378967cbda00ae01380_SeqId_28_ - updating store file list. 2023-10-30 06:55:35,192 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/3fe76625ffeb4378967cbda00ae01380_SeqId_28_ into 0de074978d93be6422cc45784f698210/family1 2023-10-30 06:55:35,192 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__o0mtvmq28bq493mtdl1isofch596sh9mdo35vc4iphtss0aecepksvhfblhiuvop/family1/ec3ab67eae1c4078a7ca0808b7d026ed into 0de074978d93be6422cc45784f698210/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/family1/3fe76625ffeb4378967cbda00ae01380_SeqId_28_) 2023-10-30 06:55:35,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__o0mtvmq28bq493mtdl1isofch596sh9mdo35vc4iphtss0aecepksvhfblhiuvop/family1/ec3ab67eae1c4078a7ca0808b7d026ed 2023-10-30 06:55:35,194 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 06:55:35,195 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:35,196 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030211f520f0a654ac9b2c5d010bf0c818b to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030211f520f0a654ac9b2c5d010bf0c818b 2023-10-30 06:55:35,197 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310306dd92221a52c4ab6a19ffee63a63bfd6 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310306dd92221a52c4ab6a19ffee63a63bfd6 2023-10-30 06:55:35,198 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030babfe15faac742e28841528270b323e7 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030babfe15faac742e28841528270b323e7 2023-10-30 06:55:35,198 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030fb1397382f02463d849d6fca559948d0 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030fb1397382f02463d849d6fca559948d0 2023-10-30 06:55:35,198 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-30 06:55:35,198 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 06:55:35,199 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 06:55:35,199 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 06:55:35,764 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030166e6ce8a5734cc3a9129cf999f61439 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030166e6ce8a5734cc3a9129cf999f61439 2023-10-30 06:55:35,765 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 06:55:35,807 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030/family1/0c9ca63e31cb436593b6eb327b4f1ca3 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-10-30 06:55:35,807 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030/family1/0c9ca63e31cb436593b6eb327b4f1ca3}] 2023-10-30 06:55:35,809 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030/family1/0c9ca63e31cb436593b6eb327b4f1ca3 for inclusion in 92d81501e99ecb332aa05a4d435c4bd1/family1 2023-10-30 06:55:35,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-10-30 06:55:35,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(777): Region bounds: first= last=1 2023-10-30 06:55:35,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 92d81501e99ecb332aa05a4d435c4bd1: 2023-10-30 06:55:35,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030/family1/0c9ca63e31cb436593b6eb327b4f1ca3 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__kurdlg7me37s1jr8he0heddr9t9u618vqin3pb6rekkk1s92nu2o7oldll76ai99/family1/0c9ca63e31cb436593b6eb327b4f1ca3 2023-10-30 06:55:35,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__kurdlg7me37s1jr8he0heddr9t9u618vqin3pb6rekkk1s92nu2o7oldll76ai99/family1/0c9ca63e31cb436593b6eb327b4f1ca3 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/70cdc24a4e1b442d9d2daa7e2e62d4e0_SeqId_28_ 2023-10-30 06:55:35,832 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__kurdlg7me37s1jr8he0heddr9t9u618vqin3pb6rekkk1s92nu2o7oldll76ai99/family1/0c9ca63e31cb436593b6eb327b4f1ca3 into 92d81501e99ecb332aa05a4d435c4bd1/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/70cdc24a4e1b442d9d2daa7e2e62d4e0_SeqId_28_ - updating store file list. 2023-10-30 06:55:35,852 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/70cdc24a4e1b442d9d2daa7e2e62d4e0_SeqId_28_ into 92d81501e99ecb332aa05a4d435c4bd1/family1 2023-10-30 06:55:35,852 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__kurdlg7me37s1jr8he0heddr9t9u618vqin3pb6rekkk1s92nu2o7oldll76ai99/family1/0c9ca63e31cb436593b6eb327b4f1ca3 into 92d81501e99ecb332aa05a4d435c4bd1/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/family1/70cdc24a4e1b442d9d2daa7e2e62d4e0_SeqId_28_) 2023-10-30 06:55:35,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__kurdlg7me37s1jr8he0heddr9t9u618vqin3pb6rekkk1s92nu2o7oldll76ai99/family1/0c9ca63e31cb436593b6eb327b4f1ca3 2023-10-30 06:55:35,854 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 06:55:35,855 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:35,856 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310305c546e920a6f43b5bc113e568ab19531 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310305c546e920a6f43b5bc113e568ab19531 2023-10-30 06:55:35,857 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103094b633495d86486b8a991cf873502d36 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103094b633495d86486b8a991cf873502d36 2023-10-30 06:55:35,858 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030aa11c68e1f3648deb55b308b5d88cbd8 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030aa11c68e1f3648deb55b308b5d88cbd8 2023-10-30 06:55:35,859 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030ef7ec505022246559079204fa21f2e9d to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030ef7ec505022246559079204fa21f2e9d 2023-10-30 06:55:35,859 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-30 06:55:35,860 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 06:55:35,860 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 06:55:35,860 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 06:55:36,427 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103052305b8ef423447a87638b4a9cd95f26 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023103052305b8ef423447a87638b4a9cd95f26 2023-10-30 06:55:36,428 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 06:55:36,467 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030/family1/b65590850f8c45adb62560894cb93cf8 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-10-30 06:55:36,468 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb., hostname=jenkins-hbase20.apache.org,40611,1698648765457, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030/family1/b65590850f8c45adb62560894cb93cf8}] 2023-10-30 06:55:36,470 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(763): Validating hfile at hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030/family1/b65590850f8c45adb62560894cb93cf8 for inclusion in 35f25523e5b1e828eda38c732550fbcb/family1 2023-10-30 06:55:36,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-10-30 06:55:36,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-30 06:55:36,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegion(2446): Flush status journal for 35f25523e5b1e828eda38c732550fbcb: 2023-10-30 06:55:36,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030/family1/b65590850f8c45adb62560894cb93cf8 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__aao972gpjf7qpbivnk03uup5ganhu3miqll2ppaaaokrc6776mg30ujrt2s8hkc8/family1/b65590850f8c45adb62560894cb93cf8 2023-10-30 06:55:36,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__aao972gpjf7qpbivnk03uup5ganhu3miqll2ppaaaokrc6776mg30ujrt2s8hkc8/family1/b65590850f8c45adb62560894cb93cf8 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/7a107123caf2401cb0c18ee86bd8752c_SeqId_28_ 2023-10-30 06:55:36,492 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(849): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__aao972gpjf7qpbivnk03uup5ganhu3miqll2ppaaaokrc6776mg30ujrt2s8hkc8/family1/b65590850f8c45adb62560894cb93cf8 into 35f25523e5b1e828eda38c732550fbcb/family1 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/7a107123caf2401cb0c18ee86bd8752c_SeqId_28_ - updating store file list. 2023-10-30 06:55:36,517 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(882): Loaded HFile hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/7a107123caf2401cb0c18ee86bd8752c_SeqId_28_ into 35f25523e5b1e828eda38c732550fbcb/family1 2023-10-30 06:55:36,517 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.HStore(855): Successfully loaded hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__aao972gpjf7qpbivnk03uup5ganhu3miqll2ppaaaokrc6776mg30ujrt2s8hkc8/family1/b65590850f8c45adb62560894cb93cf8 into 35f25523e5b1e828eda38c732550fbcb/family1 (new location: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/family1/7a107123caf2401cb0c18ee86bd8752c_SeqId_28_) 2023-10-30 06:55:36,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40611] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/staging/jenkins__testMajorCompactionFromAdmin__aao972gpjf7qpbivnk03uup5ganhu3miqll2ppaaaokrc6776mg30ujrt2s8hkc8/family1/b65590850f8c45adb62560894cb93cf8 2023-10-30 06:55:36,519 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 06:55:36,520 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:36,521 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030882e2695b4fe430bb5fd6eed5bb26b60 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030882e2695b4fe430bb5fd6eed5bb26b60 2023-10-30 06:55:36,522 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310309ac9bcb5144d40019ff58aecb4a7d508 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310309ac9bcb5144d40019ff58aecb4a7d508 2023-10-30 06:55:36,522 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030f2f332d6edba4bffb965a360888976f0 to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030f2f332d6edba4bffb965a360888976f0 2023-10-30 06:55:36,523 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030f2fd3ca722d34bbe9c74afd40a81d0cd to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030f2fd3ca722d34bbe9c74afd40a81d0cd 2023-10-30 06:55:36,523 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-30 06:55:36,523 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030' 2023-10-30 06:55:36,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 06:55:36,524 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 06:55:36,524 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 06:55:36,524 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(367): [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310301f6af6532d5c40638f248e9e919671ea_del] 2023-10-30 06:55:36,524 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:36,525 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310301f6af6532d5c40638f248e9e919671ea_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310301f6af6532d5c40638f248e9e919671ea_del 2023-10-30 06:55:36,525 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-30 06:55:36,525 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(367): [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030156a179ef95349b0849bd5c4a48c86bd_del] 2023-10-30 06:55:36,529 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:36,538 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030156a179ef95349b0849bd5c4a48c86bd_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030156a179ef95349b0849bd5c4a48c86bd_del 2023-10-30 06:55:36,539 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-30 06:55:36,539 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] compactions.PartitionedMobCompactor(367): [hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023103054733efad61845db93d3d304795ad088_del] 2023-10-30 06:55:36,539 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 06:55:36,541 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023103054733efad61845db93d3d304795ad088_del to hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023103054733efad61845db93d3d304795ad088_del 2023-10-30 06:55:36,541 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-30 06:55:36,541 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698648769868] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 06:55:36,543 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-30 06:55:36,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.8180 sec 2023-10-30 06:55:36,558 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:55:36,561 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:55:36,564 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 06:55:36,567 DEBUG [Listener at localhost/40811] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 06:55:36,571 INFO [Listener at localhost/40811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 06:55:36,612 INFO [Listener at localhost/40811] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=249 (was 262), OpenFileDescriptor=645 (was 659), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=119 (was 146), ProcessCount=167 (was 167), AvailableMemoryMB=3075 (was 3205) 2023-10-30 06:55:36,612 DEBUG [Listener at localhost/40811] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f296166 to 127.0.0.1:50449 2023-10-30 06:55:36,613 DEBUG [Listener at localhost/40811] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:55:36,614 INFO [Listener at localhost/40811] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-30 06:55:36,614 INFO [Listener at localhost/40811] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 06:55:36,614 DEBUG [Listener at localhost/40811] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d4d4a7f to 127.0.0.1:50449 2023-10-30 06:55:36,614 DEBUG [Listener at localhost/40811] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:55:36,614 DEBUG [Listener at localhost/40811] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-30 06:55:36,615 DEBUG [Listener at localhost/40811] util.JVMClusterUtil(257): Found active master hash=94244836, stopped=false 2023-10-30 06:55:36,615 INFO [Listener at localhost/40811] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase20.apache.org,37859,1698648764408 2023-10-30 06:55:36,615 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-30 06:55:36,615 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-30 06:55:36,615 INFO [Listener at localhost/40811] procedure2.ProcedureExecutor(628): Stopping 2023-10-30 06:55:36,615 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 06:55:36,616 DEBUG [Listener at localhost/40811] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5be5b0d9 to 127.0.0.1:50449 2023-10-30 06:55:36,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-30 06:55:36,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-30 06:55:36,616 DEBUG [Listener at localhost/40811] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:55:36,616 INFO [Listener at localhost/40811] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,40611,1698648765457' ***** 2023-10-30 06:55:36,616 INFO [Listener at localhost/40811] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-30 06:55:36,617 INFO [RS:0;jenkins-hbase20:40611] regionserver.HeapMemoryManager(220): Stopping 2023-10-30 06:55:36,617 INFO [RS:0;jenkins-hbase20:40611] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-30 06:55:36,617 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-30 06:55:36,617 INFO [RS:0;jenkins-hbase20:40611] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-30 06:55:36,617 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 5971c46cef08b3c058774f8431adbf7f 2023-10-30 06:55:36,617 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 92d81501e99ecb332aa05a4d435c4bd1 2023-10-30 06:55:36,617 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 0de074978d93be6422cc45784f698210 2023-10-30 06:55:36,618 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 35f25523e5b1e828eda38c732550fbcb 2023-10-30 06:55:36,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5971c46cef08b3c058774f8431adbf7f, disabling compactions & flushes 2023-10-30 06:55:36,618 INFO [regionserver/jenkins-hbase20:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-10-30 06:55:36,618 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for db1da0921e563e04a85899bcf68f5d66 2023-10-30 06:55:36,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f. 2023-10-30 06:55:36,618 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 697de355dc3b2b8aa4f7ba137d4c52e6 2023-10-30 06:55:36,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f. 2023-10-30 06:55:36,618 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4 2023-10-30 06:55:36,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f. after waiting 0 ms 2023-10-30 06:55:36,618 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 43679c57208aa4c0c4684e9c52821d7e 2023-10-30 06:55:36,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f. 2023-10-30 06:55:36,618 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 6c8ae1419fa390e22431c371aa66933e 2023-10-30 06:55:36,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 5971c46cef08b3c058774f8431adbf7f 1/1 column families, dataSize=109 B heapSize=592 B 2023-10-30 06:55:36,618 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 305c2d1857b49805ca7b04e765dbff9e 2023-10-30 06:55:36,618 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for c3e30d703d05e89f358fe3734d065edf 2023-10-30 06:55:36,618 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 0c0f560567c2bce5ddb5cadb54500eb2 2023-10-30 06:55:36,618 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:55:36,618 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for c9cc40ce683e8c632aae150d7ae235fb 2023-10-30 06:55:36,618 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for a0188f6e341e706b75eb054b66e35546 2023-10-30 06:55:36,619 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 7877490b556991f4156d5cae8f527ba0 2023-10-30 06:55:36,619 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 570b991da0936dd868ef50ca1259021d 2023-10-30 06:55:36,619 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for f040c33a0574cbb9f453444bee0294f2 2023-10-30 06:55:36,619 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 6a100adb532ef31b5553c0d8a0391ae5 2023-10-30 06:55:36,619 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 08334b8a91b43e79f682fea554e7c5b6 2023-10-30 06:55:36,619 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:36,619 DEBUG [RS:0;jenkins-hbase20:40611] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7904e8bd to 127.0.0.1:50449 2023-10-30 06:55:36,619 DEBUG [RS:0;jenkins-hbase20:40611] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:55:36,620 INFO [RS:0;jenkins-hbase20:40611] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-30 06:55:36,620 INFO [RS:0;jenkins-hbase20:40611] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-30 06:55:36,620 INFO [RS:0;jenkins-hbase20:40611] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-30 06:55:36,620 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-30 06:55:36,620 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-10-30 06:55:36,621 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-30 06:55:36,621 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-30 06:55:36,621 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-30 06:55:36,621 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-30 06:55:36,621 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-30 06:55:36,621 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-10-30 06:55:36,621 DEBUG [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1504): Waiting on 08334b8a91b43e79f682fea554e7c5b6, 0c0f560567c2bce5ddb5cadb54500eb2, 0de074978d93be6422cc45784f698210, 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4, 1588230740, 305c2d1857b49805ca7b04e765dbff9e, 35f25523e5b1e828eda38c732550fbcb, 43679c57208aa4c0c4684e9c52821d7e, 570b991da0936dd868ef50ca1259021d, 5971c46cef08b3c058774f8431adbf7f, 697de355dc3b2b8aa4f7ba137d4c52e6, 6a100adb532ef31b5553c0d8a0391ae5, 6c8ae1419fa390e22431c371aa66933e, 7877490b556991f4156d5cae8f527ba0, 92d81501e99ecb332aa05a4d435c4bd1, a0188f6e341e706b75eb054b66e35546, c3e30d703d05e89f358fe3734d065edf, c9cc40ce683e8c632aae150d7ae235fb, db1da0921e563e04a85899bcf68f5d66, f040c33a0574cbb9f453444bee0294f2, fd2fe0ed654295f84d64a2166ce6f05f 2023-10-30 06:55:36,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/namespace/5971c46cef08b3c058774f8431adbf7f/.tmp/info/2e5d249fda1944bf8b6049a468667454 2023-10-30 06:55:36,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/namespace/5971c46cef08b3c058774f8431adbf7f/.tmp/info/2e5d249fda1944bf8b6049a468667454 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/namespace/5971c46cef08b3c058774f8431adbf7f/info/2e5d249fda1944bf8b6049a468667454 2023-10-30 06:55:36,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/namespace/5971c46cef08b3c058774f8431adbf7f/info/2e5d249fda1944bf8b6049a468667454, entries=3, sequenceid=7, filesize=4.8 K 2023-10-30 06:55:36,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 5971c46cef08b3c058774f8431adbf7f in 35ms, sequenceid=7, compaction requested=false 2023-10-30 06:55:36,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/namespace/5971c46cef08b3c058774f8431adbf7f/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-10-30 06:55:36,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f. 2023-10-30 06:55:36,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5971c46cef08b3c058774f8431adbf7f: 2023-10-30 06:55:36,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1698648768335.5971c46cef08b3c058774f8431adbf7f. 2023-10-30 06:55:36,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 92d81501e99ecb332aa05a4d435c4bd1, disabling compactions & flushes 2023-10-30 06:55:36,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:36,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:36,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. after waiting 0 ms 2023-10-30 06:55:36,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:36,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/92d81501e99ecb332aa05a4d435c4bd1/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 06:55:36,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:36,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 92d81501e99ecb332aa05a4d435c4bd1: 2023-10-30 06:55:36,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1698648917528.92d81501e99ecb332aa05a4d435c4bd1. 2023-10-30 06:55:36,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0de074978d93be6422cc45784f698210, disabling compactions & flushes 2023-10-30 06:55:36,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:36,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:36,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. after waiting 0 ms 2023-10-30 06:55:36,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:36,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/0de074978d93be6422cc45784f698210/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 06:55:36,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:36,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0de074978d93be6422cc45784f698210: 2023-10-30 06:55:36,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1698648917528.0de074978d93be6422cc45784f698210. 2023-10-30 06:55:36,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 35f25523e5b1e828eda38c732550fbcb, disabling compactions & flushes 2023-10-30 06:55:36,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:36,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:36,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. after waiting 0 ms 2023-10-30 06:55:36,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:36,698 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-30 06:55:36,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionFromAdmin/35f25523e5b1e828eda38c732550fbcb/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 06:55:36,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:36,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 35f25523e5b1e828eda38c732550fbcb: 2023-10-30 06:55:36,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1698648917528.35f25523e5b1e828eda38c732550fbcb. 2023-10-30 06:55:36,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing db1da0921e563e04a85899bcf68f5d66, disabling compactions & flushes 2023-10-30 06:55:36,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:55:36,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:55:36,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. after waiting 0 ms 2023-10-30 06:55:36,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:55:36,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/db1da0921e563e04a85899bcf68f5d66/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-10-30 06:55:36,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:55:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for db1da0921e563e04a85899bcf68f5d66: 2023-10-30 06:55:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1698648805483.db1da0921e563e04a85899bcf68f5d66. 2023-10-30 06:55:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 697de355dc3b2b8aa4f7ba137d4c52e6, disabling compactions & flushes 2023-10-30 06:55:36,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:55:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:55:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. after waiting 0 ms 2023-10-30 06:55:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:55:36,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/697de355dc3b2b8aa4f7ba137d4c52e6/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-10-30 06:55:36,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:55:36,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 697de355dc3b2b8aa4f7ba137d4c52e6: 2023-10-30 06:55:36,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698648840381.697de355dc3b2b8aa4f7ba137d4c52e6. 2023-10-30 06:55:36,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4, disabling compactions & flushes 2023-10-30 06:55:36,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:55:36,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:55:36,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. after waiting 0 ms 2023-10-30 06:55:36,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:55:36,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/0ff0bf9cf9b6b7c50c2bdb9357b7e7a4/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-10-30 06:55:36,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:55:36,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0ff0bf9cf9b6b7c50c2bdb9357b7e7a4: 2023-10-30 06:55:36,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1698648805483.0ff0bf9cf9b6b7c50c2bdb9357b7e7a4. 2023-10-30 06:55:36,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 43679c57208aa4c0c4684e9c52821d7e, disabling compactions & flushes 2023-10-30 06:55:36,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:55:36,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:55:36,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. after waiting 0 ms 2023-10-30 06:55:36,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:55:36,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyPolicy/43679c57208aa4c0c4684e9c52821d7e/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-30 06:55:36,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:55:36,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 43679c57208aa4c0c4684e9c52821d7e: 2023-10-30 06:55:36,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1698648810611.43679c57208aa4c0c4684e9c52821d7e. 2023-10-30 06:55:36,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6c8ae1419fa390e22431c371aa66933e, disabling compactions & flushes 2023-10-30 06:55:36,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:55:36,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:55:36,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. after waiting 0 ms 2023-10-30 06:55:36,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:55:36,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/6c8ae1419fa390e22431c371aa66933e/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-10-30 06:55:36,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:55:36,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6c8ae1419fa390e22431c371aa66933e: 2023-10-30 06:55:36,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698648824664.6c8ae1419fa390e22431c371aa66933e. 2023-10-30 06:55:36,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 305c2d1857b49805ca7b04e765dbff9e, disabling compactions & flushes 2023-10-30 06:55:36,751 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:55:36,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:55:36,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. after waiting 0 ms 2023-10-30 06:55:36,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:55:36,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/305c2d1857b49805ca7b04e765dbff9e/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-30 06:55:36,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:55:36,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 305c2d1857b49805ca7b04e765dbff9e: 2023-10-30 06:55:36,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698648770001.305c2d1857b49805ca7b04e765dbff9e. 2023-10-30 06:55:36,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c3e30d703d05e89f358fe3734d065edf, disabling compactions & flushes 2023-10-30 06:55:36,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:55:36,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:55:36,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. after waiting 0 ms 2023-10-30 06:55:36,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:55:36,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/c3e30d703d05e89f358fe3734d065edf/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 06:55:36,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:55:36,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c3e30d703d05e89f358fe3734d065edf: 2023-10-30 06:55:36,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1698648887520.c3e30d703d05e89f358fe3734d065edf. 2023-10-30 06:55:36,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0c0f560567c2bce5ddb5cadb54500eb2, disabling compactions & flushes 2023-10-30 06:55:36,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:55:36,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:55:36,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. after waiting 0 ms 2023-10-30 06:55:36,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:55:36,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/0c0f560567c2bce5ddb5cadb54500eb2/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 06:55:36,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:55:36,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0c0f560567c2bce5ddb5cadb54500eb2: 2023-10-30 06:55:36,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1698648887520.0c0f560567c2bce5ddb5cadb54500eb2. 2023-10-30 06:55:36,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing fd2fe0ed654295f84d64a2166ce6f05f, disabling compactions & flushes 2023-10-30 06:55:36,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:55:36,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:55:36,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. after waiting 0 ms 2023-10-30 06:55:36,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:55:36,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/fd2fe0ed654295f84d64a2166ce6f05f/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-30 06:55:36,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:55:36,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for fd2fe0ed654295f84d64a2166ce6f05f: 2023-10-30 06:55:36,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1698648861904.fd2fe0ed654295f84d64a2166ce6f05f. 2023-10-30 06:55:36,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c9cc40ce683e8c632aae150d7ae235fb, disabling compactions & flushes 2023-10-30 06:55:36,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:36,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:36,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. after waiting 0 ms 2023-10-30 06:55:36,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:36,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithMonthlyPolicy/c9cc40ce683e8c632aae150d7ae235fb/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-10-30 06:55:36,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:36,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c9cc40ce683e8c632aae150d7ae235fb: 2023-10-30 06:55:36,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1698648904296.c9cc40ce683e8c632aae150d7ae235fb. 2023-10-30 06:55:36,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a0188f6e341e706b75eb054b66e35546, disabling compactions & flushes 2023-10-30 06:55:36,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:55:36,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:55:36,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. after waiting 0 ms 2023-10-30 06:55:36,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:55:36,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/ns/testMinorCompaction/a0188f6e341e706b75eb054b66e35546/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 06:55:36,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:55:36,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a0188f6e341e706b75eb054b66e35546: 2023-10-30 06:55:36,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1698648887520.a0188f6e341e706b75eb054b66e35546. 2023-10-30 06:55:36,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7877490b556991f4156d5cae8f527ba0, disabling compactions & flushes 2023-10-30 06:55:36,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:55:36,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:55:36,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. after waiting 0 ms 2023-10-30 06:55:36,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:55:36,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMajorCompactionWithMonthlyPolicy/7877490b556991f4156d5cae8f527ba0/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-10-30 06:55:36,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:55:36,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7877490b556991f4156d5cae8f527ba0: 2023-10-30 06:55:36,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1698648781819.7877490b556991f4156d5cae8f527ba0. 2023-10-30 06:55:36,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 570b991da0936dd868ef50ca1259021d, disabling compactions & flushes 2023-10-30 06:55:36,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:55:36,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:55:36,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. after waiting 0 ms 2023-10-30 06:55:36,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:55:36,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/570b991da0936dd868ef50ca1259021d/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-30 06:55:36,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:55:36,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 570b991da0936dd868ef50ca1259021d: 2023-10-30 06:55:36,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1698648861904.570b991da0936dd868ef50ca1259021d. 2023-10-30 06:55:36,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f040c33a0574cbb9f453444bee0294f2, disabling compactions & flushes 2023-10-30 06:55:36,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:55:36,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:55:36,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. after waiting 0 ms 2023-10-30 06:55:36,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:55:36,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testCompactionWithHFileLink/f040c33a0574cbb9f453444bee0294f2/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-30 06:55:36,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:55:36,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f040c33a0574cbb9f453444bee0294f2: 2023-10-30 06:55:36,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1698648861904.f040c33a0574cbb9f453444bee0294f2. 2023-10-30 06:55:36,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6a100adb532ef31b5553c0d8a0391ae5, disabling compactions & flushes 2023-10-30 06:55:36,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:55:36,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:55:36,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. after waiting 0 ms 2023-10-30 06:55:36,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:55:36,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testScannerOnBulkLoadRefHFiles/6a100adb532ef31b5553c0d8a0391ae5/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-10-30 06:55:36,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:55:36,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6a100adb532ef31b5553c0d8a0391ae5: 2023-10-30 06:55:36,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1698648805483.6a100adb532ef31b5553c0d8a0391ae5. 2023-10-30 06:55:36,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 08334b8a91b43e79f682fea554e7c5b6, disabling compactions & flushes 2023-10-30 06:55:36,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:55:36,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:55:36,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. after waiting 0 ms 2023-10-30 06:55:36,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:55:36,822 DEBUG [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1504): Waiting on 08334b8a91b43e79f682fea554e7c5b6, 1588230740 2023-10-30 06:55:36,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/default/testMinorCompactionWithWeeklyPolicy/08334b8a91b43e79f682fea554e7c5b6/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-10-30 06:55:36,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:55:36,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 08334b8a91b43e79f682fea554e7c5b6: 2023-10-30 06:55:36,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1698648794145.08334b8a91b43e79f682fea554e7c5b6. 2023-10-30 06:55:36,935 INFO [regionserver/jenkins-hbase20:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-30 06:55:36,935 INFO [regionserver/jenkins-hbase20:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-30 06:55:37,022 DEBUG [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-30 06:55:37,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/.tmp/info/5e2d3cfbf0644cc5aa8e76d304637668 2023-10-30 06:55:37,051 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e2d3cfbf0644cc5aa8e76d304637668 2023-10-30 06:55:37,057 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/.tmp/rep_barrier/4f922bbaa7774f7a8344ebc208c6c0a7 2023-10-30 06:55:37,062 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f922bbaa7774f7a8344ebc208c6c0a7 2023-10-30 06:55:37,222 DEBUG [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-30 06:55:37,422 DEBUG [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-30 06:55:37,468 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/.tmp/table/37ca63e5e97d407181ddc19da33cf826 2023-10-30 06:55:37,473 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37ca63e5e97d407181ddc19da33cf826 2023-10-30 06:55:37,474 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/.tmp/info/5e2d3cfbf0644cc5aa8e76d304637668 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/info/5e2d3cfbf0644cc5aa8e76d304637668 2023-10-30 06:55:37,478 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e2d3cfbf0644cc5aa8e76d304637668 2023-10-30 06:55:37,478 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/info/5e2d3cfbf0644cc5aa8e76d304637668, entries=226, sequenceid=130, filesize=37.9 K 2023-10-30 06:55:37,478 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/.tmp/rep_barrier/4f922bbaa7774f7a8344ebc208c6c0a7 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/rep_barrier/4f922bbaa7774f7a8344ebc208c6c0a7 2023-10-30 06:55:37,482 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f922bbaa7774f7a8344ebc208c6c0a7 2023-10-30 06:55:37,482 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/rep_barrier/4f922bbaa7774f7a8344ebc208c6c0a7, entries=1, sequenceid=130, filesize=5.0 K 2023-10-30 06:55:37,483 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/.tmp/table/37ca63e5e97d407181ddc19da33cf826 as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/table/37ca63e5e97d407181ddc19da33cf826 2023-10-30 06:55:37,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37ca63e5e97d407181ddc19da33cf826 2023-10-30 06:55:37,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/table/37ca63e5e97d407181ddc19da33cf826, entries=27, sequenceid=130, filesize=6.6 K 2023-10-30 06:55:37,493 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 872ms, sequenceid=130, compaction requested=false 2023-10-30 06:55:37,507 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-10-30 06:55:37,508 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-30 06:55:37,508 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-30 06:55:37,508 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-30 06:55:37,508 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-30 06:55:37,623 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,40611,1698648765457; all regions closed. 2023-10-30 06:55:37,630 DEBUG [RS:0;jenkins-hbase20:40611] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/oldWALs 2023-10-30 06:55:37,630 INFO [RS:0;jenkins-hbase20:40611] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C40611%2C1698648765457.meta:.meta(num 1698648768078) 2023-10-30 06:55:37,634 DEBUG [RS:0;jenkins-hbase20:40611] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/oldWALs 2023-10-30 06:55:37,634 INFO [RS:0;jenkins-hbase20:40611] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C40611%2C1698648765457:(num 1698648767083) 2023-10-30 06:55:37,634 DEBUG [RS:0;jenkins-hbase20:40611] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:55:37,634 INFO [RS:0;jenkins-hbase20:40611] regionserver.LeaseManager(133): Closed leases 2023-10-30 06:55:37,634 INFO [RS:0;jenkins-hbase20:40611] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-30 06:55:37,635 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-30 06:55:37,635 INFO [RS:0;jenkins-hbase20:40611] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:40611 2023-10-30 06:55:37,642 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-30 06:55:37,642 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,40611,1698648765457 2023-10-30 06:55:37,642 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-30 06:55:37,642 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,40611,1698648765457] 2023-10-30 06:55:37,642 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,40611,1698648765457; numProcessing=1 2023-10-30 06:55:37,643 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,40611,1698648765457 already deleted, retry=false 2023-10-30 06:55:37,643 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase20.apache.org,40611,1698648765457 expired; onlineServers=0 2023-10-30 06:55:37,643 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,37859,1698648764408' ***** 2023-10-30 06:55:37,643 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-30 06:55:37,644 DEBUG [M:0;jenkins-hbase20:37859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44a305df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-30 06:55:37,644 INFO [M:0;jenkins-hbase20:37859] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,37859,1698648764408 2023-10-30 06:55:37,644 INFO [M:0;jenkins-hbase20:37859] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,37859,1698648764408; all regions closed. 2023-10-30 06:55:37,644 DEBUG [M:0;jenkins-hbase20:37859] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 06:55:37,644 DEBUG [M:0;jenkins-hbase20:37859] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-30 06:55:37,645 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-30 06:55:37,645 DEBUG [M:0;jenkins-hbase20:37859] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-30 06:55:37,645 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698648766784] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698648766784,5,FailOnTimeoutGroup] 2023-10-30 06:55:37,645 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698648766786] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698648766786,5,FailOnTimeoutGroup] 2023-10-30 06:55:37,645 INFO [M:0;jenkins-hbase20:37859] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-30 06:55:37,645 INFO [M:0;jenkins-hbase20:37859] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-30 06:55:37,645 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-30 06:55:37,645 INFO [M:0;jenkins-hbase20:37859] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-10-30 06:55:37,645 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 06:55:37,645 DEBUG [M:0;jenkins-hbase20:37859] master.HMaster(1512): Stopping service threads 2023-10-30 06:55:37,646 INFO [M:0;jenkins-hbase20:37859] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-30 06:55:37,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-30 06:55:37,646 ERROR [M:0;jenkins-hbase20:37859] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-10-30 06:55:37,646 INFO [M:0;jenkins-hbase20:37859] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-30 06:55:37,646 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-30 06:55:37,647 DEBUG [M:0;jenkins-hbase20:37859] zookeeper.ZKUtil(398): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-30 06:55:37,647 WARN [M:0;jenkins-hbase20:37859] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-30 06:55:37,647 INFO [M:0;jenkins-hbase20:37859] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-30 06:55:37,647 INFO [M:0;jenkins-hbase20:37859] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-30 06:55:37,647 DEBUG [M:0;jenkins-hbase20:37859] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-30 06:55:37,647 INFO [M:0;jenkins-hbase20:37859] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 06:55:37,647 DEBUG [M:0;jenkins-hbase20:37859] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 06:55:37,647 DEBUG [M:0;jenkins-hbase20:37859] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-30 06:55:37,647 DEBUG [M:0;jenkins-hbase20:37859] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 06:55:37,647 INFO [M:0;jenkins-hbase20:37859] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.35 KB heapSize=599.13 KB 2023-10-30 06:55:37,743 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-30 06:55:37,743 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): regionserver:40611-0x101819dfdcb0001, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-30 06:55:37,743 INFO [RS:0;jenkins-hbase20:40611] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,40611,1698648765457; zookeeper connection closed. 2023-10-30 06:55:37,743 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@184702a0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@184702a0 2023-10-30 06:55:37,744 INFO [Listener at localhost/40811] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-10-30 06:55:38,054 INFO [M:0;jenkins-hbase20:37859] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.35 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/080f2786597f470ba1f77a9d55776cea 2023-10-30 06:55:38,058 INFO [M:0;jenkins-hbase20:37859] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 080f2786597f470ba1f77a9d55776cea 2023-10-30 06:55:38,058 DEBUG [M:0;jenkins-hbase20:37859] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/080f2786597f470ba1f77a9d55776cea as hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/080f2786597f470ba1f77a9d55776cea 2023-10-30 06:55:38,062 INFO [M:0;jenkins-hbase20:37859] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 080f2786597f470ba1f77a9d55776cea 2023-10-30 06:55:38,062 INFO [M:0;jenkins-hbase20:37859] regionserver.HStore(1080): Added hdfs://localhost:36111/user/jenkins/test-data/21656f54-43e1-1b1d-8f9a-78ae81479d10/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/080f2786597f470ba1f77a9d55776cea, entries=123, sequenceid=1006, filesize=33.3 K 2023-10-30 06:55:38,063 INFO [M:0;jenkins-hbase20:37859] regionserver.HRegion(2948): Finished flush of dataSize ~513.35 KB/525666, heapSize ~599.11 KB/613488, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 416ms, sequenceid=1006, compaction requested=false 2023-10-30 06:55:38,063 INFO [M:0;jenkins-hbase20:37859] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 06:55:38,063 DEBUG [M:0;jenkins-hbase20:37859] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-30 06:55:38,066 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-30 06:55:38,066 INFO [M:0;jenkins-hbase20:37859] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-30 06:55:38,067 INFO [M:0;jenkins-hbase20:37859] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:37859 2023-10-30 06:55:38,068 DEBUG [M:0;jenkins-hbase20:37859] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,37859,1698648764408 already deleted, retry=false 2023-10-30 06:55:38,169 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-30 06:55:38,169 INFO [M:0;jenkins-hbase20:37859] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,37859,1698648764408; zookeeper connection closed. 2023-10-30 06:55:38,169 DEBUG [Listener at localhost/40811-EventThread] zookeeper.ZKWatcher(600): master:37859-0x101819dfdcb0000, quorum=127.0.0.1:50449, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-30 06:55:38,171 WARN [Listener at localhost/40811] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-30 06:55:38,174 INFO [Listener at localhost/40811] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-30 06:55:38,280 WARN [BP-352835126-148.251.75.209-1698648760718 heartbeating to localhost/127.0.0.1:36111] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-30 06:55:38,280 WARN [BP-352835126-148.251.75.209-1698648760718 heartbeating to localhost/127.0.0.1:36111] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-352835126-148.251.75.209-1698648760718 (Datanode Uuid 30dca24f-77be-4440-9d6d-61edddf4be81) service to localhost/127.0.0.1:36111 2023-10-30 06:55:38,282 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/cluster_c61b2f97-6a79-fbf9-8770-5add71ee2b48/dfs/data/data1/current/BP-352835126-148.251.75.209-1698648760718] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-30 06:55:38,283 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/e07fea65-0f3f-040f-a5c6-997d7c5a725b/cluster_c61b2f97-6a79-fbf9-8770-5add71ee2b48/dfs/data/data2/current/BP-352835126-148.251.75.209-1698648760718] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-30 06:55:38,307 INFO [Listener at localhost/40811] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-30 06:55:38,333 INFO [Listener at localhost/40811] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-30 06:55:38,414 INFO [Listener at localhost/40811] hbase.HBaseTestingUtility(1293): Minicluster is down